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ABSTRACT 

This textbook presents a conceptual and 
methodological framework for implementing quality assurance programs 
in mental health services, with specific emphasis on peer and 
utilization review. Both the content of the review and the methods of 
accomplishing it are addressed. The early chapters of the book are 
designed to show the many types and styles of evaluation criteria 
available, and to help readers determine what is appropriate for 
their facility. Mechanisms for measuring the quality of care and the 
process of concurrent and retrospective review are described. 
Different criteria formats and modes of criteria development are 
outlined, with specific attention paid to the concurrent review of 
partial hospitalization and ambulatory services. The implementation 
of a quality assurance program is then discussed. The quality 
assurance cycle is described and educational and organizational 
interventions are outlined. The focus of the book then shifts to the 
nature of organizations, to quality assurance activities within the 
framework of organizations with varying structures, and to the 
establishment of a functioning utilization and peer review system. 
Numerous figures supplementing the text, an annotated bibliography, 
an author index, and a subject index are included. (JAC) 
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FOREWORD 



As the intramural educational component of the National In- 
stitute of Mental Health, The Steff College provides a multifaceted 
program of education and training activities to assist staff of NIMH 
and ADAMHA as well as others in State and local mental health 
programs around the country to maintain their effectiveness in the 
face of rapidly changing roles and responsibilities. These activities 
are developed in response to needs and in anticipation of changing 
priorities, with major emphasis on those subject areas most directly 
related to the improvement of mental health care. 

Reflecting the diversity and flexibility that have characterized 
The Staff College program since itj inception in 1974, program ac- 
tivities range from intensive courses, executive seminars, and ad- 
vanced courses for trainers and consultants, to multiphased training 
programs, College Lectures, special meetings, and conferences. The 
publication of special materials has, additionally, been a high 
priority activity for The Staff College. As an outgrowth of courses 
and other training activities, these publications have enabled the 
College to extend its program beyond the classroom or meeting 

plftCG* 

The Staff College Publication Series in Program Management 
was initiated in 1977 to provide a framework for our materials 
development efforts. This new textbook. Quality Atturance in Menr 
tal Health: Peer and Utilization Review, is an addition to that 
series. We anticipate it will continue to be useful as a text for Staff 
College courses. But, equally important, it is designed for indepen- 
dent use by staff members in Federal, State, and local programs 
with varied responsibilities for assuring the quality of mental health 
care in both institutional and community settings. We additionally 
feel that the concepts, methodology, and organizational context 
presented in this volume may be equally applicable to quality 
assurance programs in other health care settings as well. 



Harold Goldstein, Ph.D. 
Acting Director 
The Staff College 

National Institute of Mental Health 
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PREFACE 



As interest in the quality of mental health services has increased 
substantially in recent years, efforts to develop feasible and accept* 
able methods to assess and assure good quality care have inten- 
sified. But assuring the quality of mental health care has not been 
the exclusive province of mental health professionals. Government, 
third-party payors, and the general public have provided much of 
the impetus for these efforts and have become much more involved 
than ever before. This new textbook, Quality Assurance in Mental 
Health: Peer and Utilization Review, is part of that effort. 

An outgrowth of The Staff College course on Assessing the Qual* 
ity of Mental Health Services, the text presents a conceptual and 
methodological framework for implementing quality assurance pro- 
grams* By providing a working knowledge of the major principles 
and practices of quality assurance, the book aims to assist mental 
health staff in a variety of settings— community mental health 
centers, State and local agencies and institutions, and Government— 
to improve the effectiveness and efficiency of their service pro- 
grams. Its content and approach reflect the combined experience of 
the authors in teaching The Staff College course in many parts of 
the country, as well as their experience as mental health administra- 
tors, researchers, consultants, and pioneers in quality assessment in 
mental health. 

It is important to note that the concept of accountability in the 
health field is not new. In fact, the concern for the quality of mental 
health services can be viewed from the perspective of events that 
took place within the medical sector. The roots of concern for the 
adequacy of medical care can be traced to the introduction of 
medical audits in general hospitals following World War L These 
procedures became so well integrated into the medical system that 
they are now accepted practice within hospitals and institutions, 
along with requirements to earn accreditation and reimbursement. 

The role of the Federal Government has been central to the 
evolution of quality assessment, mainly through legislative and ad- 
ministrative actions that date back to the early 1960s. Three actions 
are especially important: Initially, the Federal Government 
developed a review mechanism to monitor the private medical ser- 
vices provided to dependents covered by the Department of Defense 
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CHAMPUS program. Subsequently, Federal involvement in quality 
assurance was greatly expanded by a provision in the 1965 Social 
Security Amendments that required general hospitals and extended 
care facilities to implement utilization review committees. As a 
result, national standards for Medicaid and Medicare services were 
developed. Most recently, the Federal role was further expanded 
* with the establishment under the 1972 Social Security Act of Profes- 
sional Standards Review Organizations (PSROs) to serve as in- 
dependent, external medical review bodies for Medicaid. Medicare, 
and the Maternal and Child Health Program. 

During the 19608 and 1970s, issues of accountability increasingly 
affected the mental health sector as well. Following passage of the 
Community Mental Health Centers (CMHC) Act in 1963, the em- 
phasis was on community-based alternatives to inpatient services 
and provision of services in the least restrictive setting. Paralleling 
this, demands for accountability became more vocal and were heard 
from all sides— from Government, professionals, boards, consumers, 
and ultimately from Congress itself. Program evaluation method- 
ology became a serious concern for the National Institute of Mental 
Health and for the complex and multifaceted community mental 
health center programs that were developing all over the country 
with Federal support. Evaluation activities multiplied at an im- 
pressive rate even before they were specifically mandated for in- 
dividual CMHCs in the 1975 Amendments to the CMHC Act. Signifi- 
cantly, as part of this focus on improving evaluation capability, the 
need to develop quality assessment systems within mental health, 
comparable to those already operating within the medical sector, 
became clear. 

As the national mental health agency. NIMH took the lead in 1969 
to develop the needed methodology. Thus, the first major research 
project to address the problems of quality assessment of psychiatric 
services was. with NIMH support, undertaken jointly by the Connect- 
icut Mental Health Center and Yale University -the Psychiatric 
Utilization Review and Evaluation (PURE) Project.* By drawing on 
the established principles of quality assessment in the medical sec- 
tor and the outcomes of their psychiatric utilization studies, PURE 
researchers formulated a systematic approach to quality assess- 
ment within psychiatric settings that could indeed assure ad- 
ministrators. Government, third-party payors, and the public, that 



*A detailed report of this research project can be found in Riedel, D.C.; Tischler, 
G. L.; and Myers, J. K. Patient Care Evaluation in Mental Health Program*. Cam- 
bridge: Ballinger, 1974. 
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mental health services could meet key evaluation criteria -that 
they were necessary, of proper quality, and could be offered at rea- 
sonable cost within an appropriate setting for an appropriate length 
of time. 

Though the Federal Government continued to encourage and sup- 
port efforts to improve and refine quality assessment procedures in 
mental health settings, the next major impetus to the development 
of quality assessment systems came as a result of new provisions in 
the CMHC Amendments of 1975 that mandated evaluating the effec- 
tiveness of service programs, reviewing the quality of services, and 
establishing "an ongoing quality assurance program (including 
utilization and peer review systems)." As legislation gave new and 
special prominence to the concern for the quality of mental health 
services, important questions arose. How should CMHCs approach 
this new Usk? What was quality of service and how could it be 
measured? What was an acceptable quality assurance plan and what 
were the components of a quality assurance system? Not surpris- 
ingly, the complexity of the questions and the general lack of knowl- 
edge about this area resulted in a widespread expression of need for 
special training. In response. The Staff College developed the 
course, Assessing the Quality of Mental Health Services, that led to 
the publication of this textbook. 

The course focused on the "state of the art," the technology of 
quality assessment -but with an additional critical component to 
enhance its applicability to a range of diversified menUl health ser- 
vice settings. Since quality assurance systems depend upon working 
through the most delicate interpersonal, interdisciplinary, and in- 
traorganizational relationrhips, a core component was incorporated 
into the course curriculum that dealt with the nature and structure 
of organizations and the impact of organizational structure on qual- 
ity assessment practices and processes, sUff roles and respon- 
sibilities, and the effectiveness of quality assurance activities. As a 
result, the methodology for developing and implementing quality 
assurance systems and processes was presented in the context of 
the organization within which these systems must function. This in- 
tegration of methodology and organizational theory and practice is 
similarly reflected in the book. 

As indicated earlier. Quality Ataurance in Mental Health: Peer 
and Utilization Review is designed to teach basic concepts and 
methods. Though institutional and community mental health center 
programs are used to illustrate the methodology, it should be em- 
phasized that the application of the approaches described in the 
book is not restricted to these settings. Settings may change; basic 
guidelines and methodology remain valid. Once learned, they can be 
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applied and extended to a whole range of mental health settings and 
programs —as mechanisms for program monitoring and improve- 
ment, as educational tools, and as mechanisms for improving the ef- 
fective and efficient utilization of staff and fiscal resources. 



Isabel Davidoff 
Assistant Director 
The Staff College 

National Institute of Mental Health 
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INTRODUCTION 



QUALITY ASSURANCE IN 
MENTAL HEALTH: 
An Overview 



To the extent that each of us constantly weighs alternatives in 
order to decide whether a particular course of action is practical or 
impractical, good or bad, honest or dishonest, we are evaluative 
animals. Evaluations help us establish personal priorities, deter- 
mine our goals, and identify acceptable means for achieving these 
goals. The realization that evaluative judgments can challenge the 
validity of cherished activities or limit our range of action, however, 
makes us more comfortable in the role of the evaluator than the 
evaluated. The discomfort of being evaluated is particularly acute 
when a profession is concerned. 

Eliot Freidson (1970) identifies a profession as ''an occupation 
which has assumed the dominant position in the division of labor, so 
that it gains control over the determination of the substance of its 
own work.** Thus, professionals are likely to view themselves as 
self-directing. Any encroachment or threatened encroachment upon 
the freedom to define a domain of practice is experienced as a viola- 
tion of entitlement. The reaction is visceral as professionals respond 
to what is perceived as an assault upon the trustworthiness, ethical 
behavior, and knowledge base which legitimize their unique occupa- 
tional status. 
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When a call for evaluation arises from outside a profeasion» it in- 
variably generates tension and meets with resistance. We have 
witnessed such responses during the past decade as health and 
human service professions have come under increased scrutiny and 
review; The possibility always exists that an acknowledged need to 
evaluate the activities of a profession will be transformed into an 
act of expedience— an exercise in form rather than substance. This» 
however» need not be. In this textbook, a guide to quality assurance 
activities in mental health is offered with a specific emphasis on 
peer and utilization review. The book attempts to address both the 
content of the review and the methods for accomplishing it, keeping 
con5tantly in mind both the overt and subtle barriers to true quality 
assurance. 

Without minimizing the impact of outside events and pressures, * 
the authors of this bock hope that it will help demonstrate that 
quality assurance in mental health is here to stay for its own sake. 
Assuring such quality is important not merely because it has been 
mandated but because of its potential for contributing positively to 
planning and decisionmaking. 
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HISTORICAL PERSPECTIVE: HEALTH RIGHTS, 
CONSUMERISM, AND COST 

Gerald Klerman (1974) advances the premise that the status of 
mental health services in this country is historically dependent 
upon the economic stability of the nation. He notes that ''marked 
fluctuations exist in public attitudes and professional activities in 
mental health . . . periods of reform, innovation and optimism have 
been followed by phases of criticism, disillusionment, dissension, 
and retrenchment . . . these reforms in mental health have coincided 
with periods of progressive social change in the larger American 
society, whereas the phases of reactions, criticisms, and retrench- 
ment have occurred with the aftermath of war or economic decline." 

The recent expansion in social welfare and public health services 
closely followed the postwar prosperity of the 1950s. The Federal 
Community Mental Health Centers (CMHC) Program evolved dur- 
ing the mid^sixties at the high point of that period of reform and in- 
novation. One of the major themes of the period was the belief that 
needt not personal circumstance or income, should determine the 
availability of health care— a belief that reflects the Aristotelean 
premise: 

Health of mind and body i$ to fundamental to the good life 
that if a penon kai any right as a citizen, then he hoi an ab- 
iolute moral right to jucA a measure of good health oi 
society and society <Uone is able to provide, 
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The view of health care as a basic human right is a concept of 
enormous subjective force. It was the motivating factor in Federal 
initiatives such as the Medicare and Medicaid programs. 

Paralleling the health rights movement was a strong drive 
toward consumerism. In the health field» consumerism is a theme 
that has been played out primarily around the issue of citizen and 
community participation. The Economic Opportunity Act of 1964 
called for programs to be ''developed» conducted » and administered 
with the maximum feasible participation of the residents of the 
areas and members of the group served/' The importance of citizen 
involvement was also stressed in the CMHC Program. Legislation 
incorporated! or at least hinted at» the tenet; funding sources 
underlined its importance; and regulations attempted» with varying 
degrees of succes8» to explicate the principle. Most recently» strong 
emphasis has been placed upon citizen involvement in the health- 
planning initiatives undertaken at the Federal level, 

Another significant aspect of consumerism is the belief that the 
recipient of a service has the right to raise questions about the ser- 
vices provided. The burden of proving that the service matches its 
claims falls to the provider. To the extent that consumers may not 
have sufficient knowledge to verify or judge what they have been 
toldi however» a third party often assumes the role of consumer ad- 
vocate. In the health area, governmental involvement is seen as a 
method for protecting the interests of the consumer with govern- 
ment agencies playing the role of advocate through the use of their 
regulatory authority. 

The decade between 1966 and 1976 also witnessed an increase in 
expenditures for health care from $38.9 billion to $118.6 billion a 
year. The portion of the gross national product spent for health rose 
from 6.9 percent in 1966 to 8.3 percent in 1975. Over half the popula- 
tion of this Nation is currently covered by some form of private or 
subsidized public health insurance* These programs commit a third 
party to reimburse the provider for the expense of covered services. 
Since third-party payments are substantia^ their purchasing power 
can be used to effect change. Recent initiatives by both governmen* 
tal and nongovernmental third parties that embody both cost con- 
tainment and evaluation requirements reflect the leverage of these 
third parties. 

TOWARDS A SYSTEM OF ACCOUNTABILITY 

The confluence of the health rights movement» consumerism» and 
the escalating cost of health care have turned the delivery, organiza- 
tion, financing, and control of health care into a highly politicized 
issue. As a result, pressure has increased for the more rigorous ap- 
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plication of principles of internal accountability! and there is grow- 
ing evidence that self-regulation, as currently practiced, must even- 
tually give way to a more pluralistic system of accountability which 
includes both the consumer and the body politic, Within this 
broader context, utilization and peer review offer not only 
systematic approaches toward achieving professional accountabil- 
ity, but also mechanisms for involving service providers in 
establishing parameters to determine both the effective utilization 
of services and the quality of care provided. 

Interest in assessing and monitoring service quality is not new. 
Questions related to the adequacy of medical care led to the in- 
troduction of the medical audit concept in general hospitals during 
the post-World War I era. By 1952, a medical audit was required by 
the Joint Commission on Accreditation of Hospitals (JCAH) for 
hospital certification. The Federal Government began to address 
questions of service quality in the mid-sixties with the passage of 
the Social Security amendments. Hospitals and skilled nursing 
homes participating in Medicare and Medicaid programs were re- 
quired to have operational utilization review programs. A utiliza- 
tion review plan was considered sufficient if it required: review on a 
sample or other basis of admissions to the institution, the durations 
of stays therein, and the professional services (including drugs and 
biologicals furnished), with respoct to the medical necessities of the 
services and for the purpose of promoting the most efficient use of 
available health facilities and services. Thus, statutory authority in 
the area of quality assurance has existed in this country for over a 
decade. 

Analyses by the Senate Finance Committee, the General Account- 
ing Office, and the Department of Health and Human Services' Audit 
Agency, however, concluded that the utilization review activities 
were generally of a token nature and ineffective in curbing the un- 
necessary use of institutional services. In the face of these findings, 
Congress enacted the Professional Standards Review Organization 
(PSRO) Program (Title 11 Part B of the Social Security Act of 
1972). Under the program, a nationwide network of voluntary, non- 
profit regionally based review organizations was established to 
determine whether services provided under the Medicare, Medic* 
aid, and Maternal and Child Health programs were necessary, of 
proper quality, and delivered in the most appropriate setting for an 
appropriate length of time. Provision was made for a PSRO to dele- 
gate its review authority to a hospital review committee. Both the 
PSRO and the delegated facility were obligated to develop and use 
explicit criteria. Three major review techniques were required: con- 
current review of individual cases, clinical care evaluation studies, 
and profile analysis. The review process of PSROs has been similar 
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to that described in the regulations drafted for provisions in P.L. 
94*63, the CMHC Amendments of 1975, and subsequent legislation 
that relate to issues of quality assurance in CMHCs. First, the 
center was to establish a committee responsible for directing the 
quality assurance program. The committee was to be multidisciplin- 
ary and representative of all relevant disciplines and service units 
involved in the delivery of care. Although the committee would be 
encouraged to develop its own review procedures, it would each 
year complete at least two clinical care evaluation studies similar to 
those required by PSROs. Criteria and standards would be 
developed for the review process and findings of the reviews 
disseminated to the center staff and r;overning body as well as to 
other appropriate bodies and persons. Finally, a plan describing the 
program would be written and made available to staff, patients, 
governing bodies, and the public. 

The draft CMHC regulations were not officially adopted. They 
were, however, reflected in the draft Program Guidelines for the 
Community Mental Health Centers Act (1979) that for a substantial 
period of time provided the field with program suggestions, 
clarifications, and amplifications of the intent of the law. As such, 
they assumed a quasi-official status in the eyes of health care profes- 
sionals, CMHC staff, community groups, and government agencies. 
In practice, CMHCs have adopted their own internal procedures for 
review of the quality of their services. These procedures vary enor- 
mously from center to center, but generally have emphasized 
review of ambulatory care in an interdisciplinary context. 

Even as this book goes to press, the external forces governing the 
nature of mental health care in this country seem to be shifting once 
again. Regardless of the outcome of these changes, it seems unlikely 
that health and mental health facilities and agencies will substan* 
tially lessen their concern for the quality of their services. On the 
contrary, as competition for existing resources increases, measures 
of accountability may well become even more critical in determining 
the scope and direction of mental health service programs. 

Against this background, this textbook presents an approach to 
utilization and peer review consistent with the aims of the CMHC 
quality assurance effort, though clearly equally applicable to a 
broad range of community mental health programs. 



MEASURING QUALITY: NORMS, CRITERlAp 
STANDARDS 

Attempts to assay the quality of care are based on the assumption 
that good care is recognizable and worth striving to attain. Good 
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care can be characterized through a set of interrelated questions 
about clinical practice: 

• Does the presenting problem justify admission to 
treatment? 

• Is the level of care offered consistent with the sev- 
erity of the presenting problem? 

• Given the nature and severity of the presenting 
problem, what length of treatment should be antic- 
ipated? 

• For a particular diagnosis or presenting problem, 
what are the critical diagnostic and therapeutic 
services required in order to maximize the proba- 
bility of a favorable outcome? 

• What problems might occur to complicate the 
course of treatment? 

• What are the key indications of successful treat- 
ment? 

These questions serve as a framework for evaluating the relation- 
ship between how care is actually provided and notions concerning 
how care ought to be provided. The evaluation itself is accomplished 
through the use of three measures of performance: norms, criteria, 
and standards. 

Norms are numerical or statistical measures that reflect the ac- 
tual practice of professionals. They are derived from aggregate data 
concerning the care provided to a large number of patients. Criteria, 
on the other hand, are developed by professionals relying on their 
clinical expertise and on the professional literature. They take the 
form of statements which provide a benchmark for judging the 
necessity, appropriateness, and adequacy of selected aspects of 
clinical care. When a norm or criterion is put forth in a manner that 
clearly specifies what is acceptable and what iS unacceptable prac- 
tice, it is referred to as a ttandard. Standards are professionally 
developed expressions of acceptable variations from a given norm 
or criterion. Thus a standard might require that 100 percent of all 
individuals hospitalized with a diagnosis of schizophrenia have an 
admissions physical examination. Lack of documentation of such ex- 
amination would require case review. 

Taken together, norms, criteria, and standards allow us to deter- 
mine both the relationship between actual and expected practice 
and the extent to which actual practice reflects the best of current 
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knowledge and opinion. Determinations based on case-by*case 
studies of individuals while still in treatment comprise the concur* 
rent review process, In contrast, retrospective review focuses on 
the care provided to a specific group of patients/clients— patients 
treated in a specific unit, sharing a particular diagnosis or subjected 
to a specific treatment intervention, for example— by studying the 
records of those who are no longer in treatment. 

In order to continuously monitor their effectiveness, mental 
health care facilities need to either adapt already formulated 
criteria or develop their own based on (1) the types of treatment 
they provide, (2) the clients and/or problems they treat, and (3) 
regional norms. The early chapters in this textbook are designed to 
show the many types and styles available and help the reader deter- 
mine what is appropriate for his facility. Mechanisms for measuring 
the quality of care and the process of concurrent and retrospective 
review are described. Different criteria formats and modes of 
criteria development are outlined, with specific attention paid to the 
application of a criterion-oriented approach to the concurrent 
review of partial hospitalization and ambulatory services. 

Having considered the mechanisms of review, the textbook then 
discusses implementation of a quality assurance program. The qual- 
ity assurance cycle is described, and educational and organizational 
interventions for assuring service quality are set forth. The focus of 
the book then shifts. Quality assurance programs exist within the 
organizational context and cannot be accomplished without an in- 
depth understanding of the full range of organizational issues. Em- 
phasis is, therefore, given in this book to the nature of organiza- 
tions, to quality assurance activities within the framework of 
organizations with varying structures, and to the establishment of a 
functioning utilization and peer review system. 
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CONCURRENT REVIEW: 
Process, Mechanisms, 
and Functions 

Concurrent review involves two related mechanisms— admission 
certification and continued-stay review. The former is conducted at 
the time of admission to the program or facility to assure that treat- 
ment is necessary. Continued*-stay review occurs during the course 
of treatment to assess the need for continued care. 

HOW DOES CONCURRBNT REVIEW WORK? 

In the concurrent review process, norms, criteria, and standards 
are used to screen a large number of cases in order to identify ex- 
ceptions to what is considered appropriate and adequate care. The 
initial screening is generally performed by a person designated as 
the review coordinator. The coordinator is responsible for the daily 
review of (1) all cases requiring either admission certification or 
recertification for continued treatment, (2) the documentation of cer- 
tification and recertification decisions, and (3) the assignment of 
length-of-stay checkpoints. Nurse clinicians, record librarians, and 
specially trained paraprofessionals have all been used as review 
coordinators. The initial screening may be done by directly review- 
ing a patient*s chart or by reviewing a specially prepared abstract 
which includes all required information. 
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Experience has shown in approximately one out of ten cases 
(Goran et al. 1975) that the review coordinator will question the ra* 
tionale for an admission. The question may arise because alternative 
levels of care are available and may be appropriate,' the diagnosis 
does not usually require the type of treatment prescribed, or the 
diagnosis has not been adequately established. When admission 
criteria are not met, the coordinator cannot take independent action 
but must refer the case to a clinician reviewer. 

The clinician reviewer examines the chart and usually speaks to 
the patient's clinician. The reviewer may then decide that the case 
meets the criteria and approve the admission. For example, he may 
find that the information justifying admission has not been ade- 
quately noted in the patient's chart. Or he may decide that the 
specific circumstances related to the individual case are somewhat 
unusual and merit treatment at the level of care to which the pa- 
tient was admitted. The clinician reviewer can also decide that the 
level of care assigned is not indicated or that the findings do not 
warrant treatment. If the admitting clinician disagrees, provision 
should be made for adjudication by a third person. This may be 
another clinician reviewer or a panel of peers. 

For those patients whose admission is certified, a second review 
date is assigned for coutinued-stay review. The interval between 
the date of admission and the second review is based on length-of- 
stay norms developed regionally in regard to levels of care and 
specific diagnoses or problems. 

The second review is performed by the review coordinator to 
determine whether indications for continued-stay exist* Once again, 
in the vast majority of cases, such indications will be documented, 
continued stay will be approved, and a new checkpoint for review 
assigned. When screening criteria justifying continued-stay are not 
met, the case is referred for clinician review* Once again, the clini- 
cian reviewer may find that indications for continued stay are pres- 
ent although not well documented, or that the case demonstrates 
unusual features that do not meet the ordinary criteria for con- 
tinued stay but justify ongoing treatment or he may find no indica- 
tion for continued stay. If continued-stay is approved, a new check- 
point will be established. 

As can be seen, the primary function of a review coordinator is to 
determine whether care provided meets pre-established criteria 
governing the necessity and appropriateness of treatment. The 
review coordinator has only the power to make positive decisions — 
that is, to identify cases where the level of care is acceptable or 
where conditions for admission to treatment or extended duration 
of stay have been met. Cases which deviate from the pre-established 
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norms and criteria must be referred for peer review. One's clinical 
peers are the only people who can decide that adequate standards of 
practice have not been met. 

•lUSTIPYINQ ADMISSION TO TREATMENT 

Decisions concerning the need for treatment and the level of care 
required are rarely made solely on the basis of mental status ex- 
aminations. Other factors -the extent to which people represent a 
threat to themselves or others, their ability to care for themselves, 
the availability of social supports or treatment resources, and prior 
response to treatment, for example -must all be considered when a 
clinician attempts to justify the necessity of treatment and specify 
the level of care. Judgments about inpatient, partial hospitalization, 
or outpatient levels of care must be objectively described. For ad- 
mission certification, three categories of criteria are commonly 
used: diagnosis-specific, generic, and problem-specific. 

Diagnosis-specific critsria 

The most common method for determining the need for treatment 
or continued care uses diagnosis-specific criteria developed in rela- 
tion to a particular condition. This method requires two steps: (1) 
establishing that the specific condition exists through the use of 
criteria validating a particular diagnosis; and (2) specifying the cir- 
cumstances that indicate the need for care through criteria justify- 
ing admission to treatment. 

Data derived from the mental status examination are generally 
relied on to validate the diagnosis. Screening criteria attempt to use 
data that are easily documented and readily retrieved from the 
clinical record, with emphasis on the minimal information required 
to reasonably establish the diagnosis. An example is provided in 
figure 1. 

Given the questions that exist about the reliability and validity of 
psychiatric diagnoses, some argue that greater rigor should 
characterize our effort at establishing a diagnosis. One possibility is 
to use specifically developed symptom scales such as the one il- 
lustrated in figure 2. 

Alternatively, it is possible to use rigorous research criteria such 
as those dev^oped by Feighner (1972) and his associates as the basis 
for validating diagnosis. These criteria cover a range of factors 
broader than just symptomatology, as the example in figure 3 sug- 
gests. 

The use of scales or research diagnostic criteria requires a more 
systematic input of basic information than the screening criteria 
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FIGURE 1 



Sor««nlng Criteria Validating tha DIagnoala off Sehliophrania 



Mental statue examination documenting: 

A. thought disorder (e.g., thinking that Is bizarre, delusional, il- 
logical, loose, blocked, autistic, markedly unrealistic, overly 
inclusive, or concrete); 

AND 

B. perceptual disorder (e.g., hallucination. Illusion, deperson- 
alization); 

OR 

C. affect disorder (affect that Is ambivalent. Inappropriate, 
blunt, or flat); 

OR 

D. disordered behavior (e.g., behavior that Is withdrawn, 
regressive, bizarre, or inappropriate). 



Source: APA Manual of Psychiatric Peer Review. American Psychiatric 
Association, Washington, D.C., 1976. Reprinted with permission. 
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Scala-Format for Validating tho DIagnoels of Sohlzophrania 



THE NEW HAVEN SCHIZOPHRENIA INDEX 
Symptoms 

1. (a) Delusions (not specified or other than depressive) 

(b) Hallucinations (auditory) 

(c) Hallucinations (visual) 

(d) Hallucinations (other) 
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2. Crazy thinking and/or thought disorder 
Any of the following: 

(a) Bizarre thinking 

(b) Autlem or grossly unreallatic private thoughts 

(0) Looseness of association, Illogical thinking, overlncluslon 

(d) Blocking 

(e) Concreteness 

(f) Derealization 

(g) Depersonalization 

3. Inappropriate affect 

4. Confusion 

5. Paranoid ideation (sel' referential thinking, suspiciousness). . 

6. Catatonic behavior 

(a) Excitement 

(b) Stupor 

(c) Waxy flexibility 

(d) Negativism 

(e) Mutism 

(f) Echofalia 

(g) Stereotyped motor activity 



Scoring System 

To be considered part of the schizophrenic group, the patient must score on 
either Item 1 or Items 2a, 2b, 2c and must attain a total score of at least 4 polnta. 
He can achieve a maximum of 4 points on Item 1: 2 for the presence of delusions, 
2 for hallucinations. 

On Item 2— he can score 2 points for any of symptoms a through c, 1 point for 
either or both symptoms d through e, and 1 point each for f and g. He can thus 
score a maximum of 5 points on Item 2. 

Items 3, 4, S, and 6 each receive i point. 

Note: Where the 4th point necessary for inclusion In the sample is provided by 
2d or 2e, these symptoms are not scored. 



Source: Astrachan, B. M.; Adier, D,; Brauer, L; Harrow, M.; Schwartz, A.; 
Schwartz, C; and Tucker, G. A checklist for the diagnosis of schizophrenia. 
British Journal of Psychiatry, 121: 529-539, 1972. Reprinted with permission of the 
copyright holder. Copyright © The British Journal of Psychiatry, 1972. 
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Checklist Format for Validating tha Diagnosis 
of Sohizoplirania 



History and mental status examination 
documenting: 

A. Both: 

1. a chronic Illness with at least six months of symptoms 
prior to the Index episode without return to the premor* 
bid level of psychosocial adjustment; 

2. absence of a period of depressive or manic symptoms 
sufficient to qualify for affective disorder or probable af- 
fective disorder. 



B. At least one of the following: 

1. delusions or hallucinations without significant perplex* 
Ity or disorientation associated with them; 

2. verbal production that makes communication difficult 
because of lack of logical or understandable organiza- 
tion. In the presence of muteness the diagnostic deci- 
sion must be deferred. 

C. At least three of the following must be present for a diagno- 
sis of **deflnlte" and f^vo for a diagnosis of '^probable" 
schizophrenia: 

1. single; 

2. premorbid social adjustment or work history poor; 

3. family history of schizophrenia; 

4. absence of alcohollsm/drug abuse within 1 year of onset 
of psychosis; 

5. onset of illness prior to age 40. 



Source: Felghner, J. P.; Robins, E.; Guze, S. B.; Woodruff, R. A.; WInokur. G.; and 
Munoz, R. Diagnostic criteria for use In psychiatric research. Archives of Gerierai 
Psychiatry, 26:57-63, 1972. Reprinted with permission of the copyright holder. 
Copyright © 1972-1976. American Medical Association. 
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displayed in figure 1. The documentation must» therefore» be more 
extensive and precise. Howevert the degree of rigor and precision 
imposed by these later methods may prove overly stringentt given 
the large number of cases to be screened» the primary focus on justi- 
fying the need for caret and the labor-intensive nature of the concur- 
rent review process* Furthermoret criteria justifying admission to 
treatment such as those illustrated in figure 4 must still be met even 
after the diagnosis has been validated* 



FIGURE 4 



Dlagnosls-Sp^clflo Criteria (Schizophrenia) Justifying 
Admission to Inpationt Caro 



A. Justification for Admission: 

1. Potential danger to self, others, or property 

OR 

2. Impaired reality testing accompanied by disordered 
behavior 

OR 

3. Need for continuous skilled observation, ECT, high-dose 
medication, or therapeutic milieu 

AND 

4. Impaired social, familial, or occupational functioning. 

B. DocumentationA/alidation 

1. Destructive gesture or threat towards self, others, or 
property 

2. Mental status examination indicating: 

perceptual disorder, OR 
thought disorder AND disordered behavior, OR 

affect disorder. 

3. Failure or unavailability of appropricte outpatient man- 
agement (A 3, 4) 



Source: Model Screening Criteria to Assist PSRO's. American Medical Associa* 
tlon, Chicago, Illinois, May 1975. Reprinted with permission of the American 
Medical Association. 



ERIC 



32 



20 



Quality Assurance In Mental Health 



Q«iittrlc criteria 

Scrutinizing diagnosis*specific criteria for a number of disorders 
soon reveals a good deal of overlap in criteria justifying admission. 
These items include indicators of functional impairment, 
dangerousness, the need for special services, the ability to respond 
to treatment, and the availability of alternative treatment 
resources— factors hardly unique to a particular diagnosis. 

Many clinicians believe that the need for treatment is governed 
more by these factors than diagnosis. They argue that validating 
the diagnosis merely adds an unnecessary step to the concurrent 
review process— particularly where hospital care is con- 
cerned—and recommend the use of npnd&^gnosis-specific level-of- 
care criteria as the sole method for justifying admission to treat- 
ment. Generic criteria of this nature have been developed for inpa- 
tient care and can be constructed either as scales (figure 5) or as 
checklists (figure 6K 

Probl«ni-sp«elflc orltoria 

Certain problems and behaviors confront clinicians with par- 
ticularly difficult decisions about hospitalization as opposed to less 
costly or restrictive treatment alternatives. In such instances* 
problem-specific hospital level-of-care criteria can facilitate the 
determination. Their use should be limited to the most common 
problems where complex decisions concerning the appropriate level 
of care are likely to occur. Suicidal behavior is clearly such a prob* 
lem. An example of problem-specific criteria justifying the involun- 
tary hospitalization of a suicidal patient is presented in figure 7. 

ESTABLISHING LENQTH-OP-STAY NORMS 

Once a person is admitted to treatment, an initial checkpoint is 
established to indicate the number of days or treatment sessions 
authorized prior to continued-stay review. This assignment is based 
upon length-of-stay (LOS) norms developed for a particular 



FIQURK 6 

So«l« for Juatif ylng Admlaalon to Inpotlont Caro 

Inttructlons to rsvlswsrs: 1) Rate each patient on each criterion as: none = 0, 
slight = Immoderate = 2» extensive = 3; multiply the rating by the weight shown 
and enter the score on each criterion. Then sum scores on each criterion for total 
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score. 2) Ratings are to be based on the patient's condition In the 7 days 
preceding evaluation for hospitalization. 3) In applying the criteria, an Item of 
reported behavior should be employed to arrive at a rating on the first criterion on 
the list to which It applies. Do not use the same Item of behavior to score a 
criterion that falls later In the list (e.g., suicidal behavior should not be used In 
rating criteria numbers 4 and 5). 

Weight Score 

1. Is there evidence of active suicidal preoccupation In fan- 



tasy or thoughts of patient? 2 

2. Have there been suicidal attempts or active prepara- 
tions to harm self (I.e., buying a gun, etc.)? 4 

3. Has the patient threatened to hurt someone else 
physically? (Limit to verbal threats only.) 2 

4. Have aggressive outbursts occurred toward people? 4 

5. Have aggressive outbursts occurred toward animals or 
objects? 2 

6. Has antisocial behavior occurred? 1 



7. Are there evidences of Impairment of such functions 
as reality assessment. Judgment, logical thinking, and 
planning? 1 

8. Does the patlent*s condition seem to be deteriorating 
rapidly or failing to Improve despite supportive 

measures? 1 

9. Are there physical or neurological conditions or a 
psychotic, disorganized state which requlre(s) hospital* 
izatlon to Initiate the treatment process? 2 

10. Does a pathological or noxious situation exist among 
patient's family or associates that makes Initiation of 
treatment without hospitalization Impossible? OR does 
the patient's disordered state create such difficulties 
for family or associates that he has to be removed and 
hospitalized for their sake? 1 

11. Are emotional contacts of the patient so severely 
limited or the habitual patterns of behavior so patho* 
logically Ingrained that the "push" of a structured 
hospital program may be helpful? (This criterion should 
not be applied to acute patients, but only to those who 
are so limited as to be unable to establish and main- 
tain emotional contacts.) 1 

12. Does evaluation of the patient's condition require the 
24-hour observation and special evaluation that a 
hospital provides? (Including stabilization or reevalna- 

tlon of medication.) 4 



Source: Flynn» H. and Henlsz, J. Criteria for psychiatric hospitalization: Ex- 
perlence with a check list for chart review. American Journal of Psychiatry, 132(8): 
847-850. August 1975. Reprinted with permission of the copyright holder. 
Copyright © The American Psychiatric Association, 1975. 
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Chttckllet Using Q«n«rle CrIUria for Juetlfying Admission 



A. General (at least one required) 

1. Suicidal preoccupation or attempt 

2. Threatened or actuai physical violence 

3. Impaired reality testing accompanied by disordered 
behavior with disruption In social, familiali and occupa* 
tional functioning 

4. Incapacitating and/or life threatening physical illness, 
but psychological components cannot optimally be 
handled on other services 

5. Behavior intolerable to client, family, or community 

6. Deleterious psychosocial interactions harmful to the pa- 
tient 

7. Failure of outpatient management or partial hospitaliza- 
tion 

AND 

B. Procedural (at least one required) 

1. Absence of alternative resources in the community 

2. Need for clarification of diagnosis by 24-hour behavioral 
observation 

3. Need to evaluate any change In the patient's condition 
(unstabllized) that might necessitate modification of 
treatment procedures 

4. Need for specialized treatment under 24-hour supervi- 
sion, e.g., EOT, lithium, high-dose drug therapy, detox- 
ification, or therapeutic milieu 
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Probi«m*Sp«Gific CriUria Justifying thm invoiuntary 
Hospitaiization of Suicidai Patianta 



Indications for Admission 

A. Current, clear suicide attempt 

B. A clear, lethal suicide plan 

0. A recent history of medically serious attempts 

D. Suicidal thoughts, gestures, or attempts In association 
with delirium or psychosis 

E. Recent marked progression In seriousness of thought or 
from thought to gestures 

F. Expression of strong suicidal thoughts with Intent without 
seeing another way out 

G. An expectation of hospitalization that cannot be changed 
at Interview 

H. Expectations of change In significant others due to 
suicidal behavior are not met nor can be changed approprl* 
ately 

L Precipitating factor cannot be changed 
J. High-risk social circumstances 



diagnosis or problem. For example, in a given year 400 patients 
with a diagnosis of acute schizophrenic reaction are admitted to in- 
patient facilities in a given region. One-half of all patients are 
discharged by the 14th day. Since length of stay is generally ex- 
pressed as a percentile, the 14th hospital day is the 50th percentile. 
Three*quarters of the patients are discharged by the 21st day. Thus 
the 75th percentile of length of stay is the 21st day of hospitaMevel 
care. Similarly, in this example, the 30th day represents the 90th 
percentile. In other words, only one of every ten patients required 
hospitaMevel care for more than 30 days. 

Most concurrent review systems use the 50th percentile as the 
LOS norm or initial checkpoint. If a patient's stay is longer than that 
of half the patients in the same region with a similar problem or 
diagnosis, it becomes necessary to clinically justify continued rare. 

While deceptively easy to develop, LOS norms should be inter- 
preted with some caution. Marked regional differences can exist in 
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measures such as average number of inpatient or partial hospitaliza- 
tion days or the mean number of outpatient visits/1000 catchment 
residents. 

Figures 8A and 8B are based upon aggregated data collected from 
federally funded community mental health centers in 1973. At this 
level of aggregation, differences among regions could reflect a host 
of factors, including the availability of alternative treatment 
resources, the help-seeking behaviors of people in a particular area, 
or the clinical philosophy of those responsible for providing care. 
Given these discrepancies, it seems wise to rely on regional rather 
than national data in establishing LOS norms. 

Even within a given region, however, LOS can vary from facility 
to facility. For example, figure 9 displays the relationship between 
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ArM lnpati«nt L^ngth-of-ttay for Patl«nts with 
Schixophr«ni6 Diagnosis (3 Paoilitlos) 




J I I I I I I I I I I I I 

3 6 9 12 15 18 21 24 27 30 33 36 39+ 

Length of stay (LOS)— days 



the number of hospital days and the percentage of patients 
discharged in a specific area with the same diagnosis— schizo- 
phrenic reaction. 

When the individual facilities are compared, as in figure 10, we 
find considerable variation at both the 50th and 75th percentiles. 

Even within the single facility, LOS norms for a given diagnosis 
can vary. Figure 11 subdivides the patient population by age (<21 
and 21 + ). While the 50th percentile is similar, a 6-day difference 
exists at the 75th percentile. 

All this is by way of saying that factors such as administrative 
policy, age, income, and availability of family supports can all in- 
fluence the application of an LOS norm. For that reason, it is impor- 
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facility Inpatient Length>of-8tay for Patients with 
Schizophrenic Diagnosis 




Length of stay (LOS)— days 

Facility A 

.... Facility B 
Facility C 



tant to regard the norm as nothing more than a general guideline. A 
person's readiness for discharge or transfer to a different level of 
care should not be reduced to a simple equation. Judgments con- 
cerning the need for continued care must also take into account the 
patient's clinical status and response to treatment. 
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JUSTIFYING THE NECESSITY FOR EXTSNDINQ 
TREATMENT 

The need for continued care is dictated by issues related to the 
clinical status of the patient, the availability of social support* and 
the existence of appropriate follow-up services. Each of the fac- 
tors must be taken into account in justifying the need for extending 
treatment. Thus it is important to know something about a patient's 
current status, the course of treatment, and the anticipated out- 
come when treatment was undertaken. This information forms the 
basis for determining whether the circumstances originally justify- 
ing admission to treatment stil! exist, whether the course of treat- 
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ment was confounded by complications or by problems in imple- 
menting a treatment program» whether certain services that can be 
provided only at the specific level of care are still required, or 
whether adequate progress has been made in relation to the original 
treatment objectives. The criteria used may be either diagnosis- 
specific or generic (see figures 12 and 13). 

PIQURI 12 

Dlagnosis-SpMific CriUria for Justifying Ixtondod LOS 



Drug Abuss/Drug Dt pt ndt net 
Adult or Adolfscf nt 

DSM-11 304 
ICDA-8 304 
HICDA 314 

L ADMISSION REVIEW 

A. Reasons for Admission 

1. Potential danger to self, others, or property, or 

2. Excessive use of drugs or other chemical substances, and 

3. Planned detoxiflcatlon/wlthdrawaK or 

4. Need for continuous skilled observation, controlled chemotherapy, or 
therapeutic milieu 

5 . Legally mandated admission 

B. Initial Length of Stay Asslgnn^ent 

Locally established based on statistical norms 

II. CONTINUED STAY REVIEW 

A. Reasons for Extending the Initial Length of Stay 

1. Continued danger to self, others, or property 

2. Continued need for detoxification/withdrawal or tiierapeutlc milieu 

3. Complication of medication 

III. VALIDATION OF 

A . Diagnosis 

1. Documentation of drug or chemical use great enough to damage 
physical health, or personal or social functioning, or as a prerequisite 
to normal social functioning, or 
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2. Documentation of Impaired social, familial, or occupational function- 
ing, and 

3. Qualitative toxicologlcal studies positive for nonprescrlbed drugs or 
chemicals, or 

4. Quantitative toxicologlcal studies showing prescribed drugs In higher 
than therapeutic levels 

B. Reasons for Admission 

1. Documented danger to self, others, or property (I-A1) 

2. Documentation of drugs/chemical abuse pattern noted above (directly 
or with supporting toxioologlcal evidence) (I-A2) 

3. Documentation of current drug/chemical toxicatlon/addlction (I-A3) 

4. Documentation of failure or unavailability of appropriate outpatient 
management (I-A4) 

IV. CRITICAL DIAGNOSTIC AND THERAPEUTIC SERVICES 



A. Toxicology screen (blood or urine) lOOVo 

B. Treatment plan to Include problem formulation, treatment goals, 
and therapeutic modalities (e.g., psychotherapy, pharmacotherapy, 
social therapies, behavior modification) 100% 

C. More than two psychotropic medications at any given time 0% 

D. Change of psychotropic medication more than twice In a seven-day 
period 0% 

E. ECT 0% 



V. DISCHARGE STATUS 

A. Achievement of Inpatient treatment goals (as outlined under IV-B) 

B. Specific follow-up treatment plan established 

VI. COMPLICATIONS 

A. Primary Disease and Treatment—Specific Complications 

1. Withdrawal seizures 

2. Complication of medication 

3. Continued drug/chemical abuse during hospitalization 

B. Nonspecific Indicators 

1. Suicide or attempt 

2. Development/peristence of psychosis after the 14th hospital day 

3. Elopement or discharge against medical advice 

4. IM psychotropic medication for more than ten days 

5. Readmisslon within 30 days of discharge 

Source: Manual of Psychiatric Peer Review, American Psychiatric Association, 
Washington, D.C., 1976. Reprinted with permission. 
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FIQURK 13 



Generic Criteria for Kxtending Initial LOS 



A. General (at least one required) 

1. Persistence of disabling symptonns 

2. Concomitant physical illness 

3. Adverse reaction to medicationi EOT 

4. Major unanticipated life stress during hospitalization 

5. Family or socioeconomic factors of sufficient severity to immediately 
cause decompensation if patient is discharged 

6. Hospital treatment career demonstrated lack of readiness for discharge, 
e.g., elopement, suicide gesture 

7. Historical evidence that previous short stay was inadequate 

8. Initial treatment goals not fully realized 



1. Planning for alternate care not complete 

a. Awaiting transfer to dependent care facility or other facility 

b. Awaiting economic support arrangements 

2. Lack of facilities for appropriate continuing care 

3. Discharge difficulties related to family and/or community rejection 

4. Initial treatment plan was changed or modified 
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B. Procedural (at least one required) 
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CHAPTER TWO 



CONCURRENT REVIEW: 
Level-of-Care 

4 

Methods must be adopted to evaluate the appropriateness of 
level-of-care within a facility. A disservice is done to both patients 
and staff if patients are misassigned or retained too long at a par- 
ticular treatment level. Ideally, concurrent admission certification 
and continued-stay review would be routine for every case. Since 
these are, however, the most labor-intensive of all review 
mechanisms, the volume of care provided by a particular institution 
as well as staffing patterns may make it impractical to review all in- 
stances of treatment. 

Level-of-care review is further complicated by the qualitative dif- 
ferences in diagnosis and expectations associated with the three ma- 
jor treatment levels: inpatient, partial hospitalization, and ambula- 
tory. One set of criteria cannot be applied across the board to deter- 
mine patient placement or release. Thus the review for each of these 
levels must be discussed separately. 

CONCURRENT REVIEW OF 
INPATIENT CARE 

Because of the relative costliness of inpatient care, hospital-level 
treatment generally receives the greatest attention. All elective in- 
patient admissions should initially be certified unless there is clear 
evidence: (1) that a specific diagnosis or a particular clinician does 
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not need such review, or (2) that available manpower is inadequate 
to handle the volume generated by a 100-percent review. Certifica- 
tion of emergency admissions to hospitals should be required either 
for all emergency admissions or for a sample of admissions that 
covers all clinicians and all major diagnoses within a reasonable 
period of time. 

As experience is garnered in concurrent review, however, it is 
possible to use the results of retrospective review efforts to identify 
areas where admission certification or continued-stay review should 
be intensified or lessened. For example, routine reviews could be 
discontinued when data demonstrate (1) the absence of admission 
denials for a particular clinician or condition, (2) excellent com- 
pliance over a period of time with length-of-stay norms for a par- 
ticular clinician or condition, or (8) consistently excellent client out- 
comes for a given condition. On the other hand, a study of the data 
may indicate that specific conditions or clinicians are especially in 
need of close surveillance* These cases can be given particular atten- 
tion in the review process. 

In other words, once diagnosis-specific and hospital level-of-care 
criteria and standards have been developed and evidence concern- 
ing admission and utilization practices is available, it becomes possi- 
ble to identify classes of admissions that can be automatically cer- 
tified or, conversely, that require close review and/or preadmission 
certification. 

CONCURRENT REVIEW OF 
PARTIAL HOSPITALIZATION 

The procedures designed for review of inpatient care can be 
modified and applied to the concurrent review of partial hospitaliza- 
tion treatment. A number of different types of day hospitals exist, 
so the development of review criteria must also take into account 
the major goals of the treatment facility. Day hospitals generally 
serve one of three functions: (1) to be an alternative to inpatient 
care; (2) to facilitate re-entry to the community; or (3) to be a 
rehabilitative setting for the chronically ill 

Those day hospitals which serve as alternatives to full-time 
hospitalization seek to intervene with patients who would otherwise 
require hospital-level treatment. Thus, criteria for admission would 
be similar to those used for inpatients. These criteria can be for- 
mulated on the basis of specific diagnoses, but they will invariably 
have to address generic issues such as the individual's functional 
capacity and the availability of social and familial support. In 
general, as shown in figure 14, it should be possible to modify 
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Admlstlons Criteria for Pay Hospital 
Used as an Alternative to Full-Tlme 
Hospitalisation 



Justification for Admission 

A. Evidence that patient requires hospitalization based 
on either dlagnosls«8peciflc or generic admissions 
criteria for hospital-level care (for example, see 
figures 47). 

B. Day hospital Is an appropriate alternative to full 
hospitalization when 

1. No major physical contraindications exist 

AND 

2. Patient Is not dangerous to self or others 

AND 

3. Adequate environmental resources are available 
to monitor and support evening and weekend 
activities. 



hospital-level criteria for this type of day hospital setting. 
Continued-stay criteria can also be modified from inpatienMevel 
criteria such as those illustrated in figures 12 and 13. 

In those day hospitals which serve to facilitate the re-entry of pa- 
tients into the communityi generic criteria will be most useful (see 
figure 15A). That is, to justify moving from inpatient care to a day 
hospital setting, the patient must demonstrate symptom improve- 
ment and enhanced functional capacity. The availability of family or 
other community resources to receive the patient is also important. 
Criteria may also be included that relate to the patient's ability to 
respond to specific therapeutic interventions such as socialization 
or prevocational training. 

Since the primary function of the day treatment setting is to pro- 
vide transition, continued-stay review is particularly important to 
establish readiness for transfer to a still less restrictive treatment 
setting. Generic criteria such as those shown in figure 16B provide 
perhaps the best way of approaching the task. 

Admission certification for day hospitals concerned with rehabili- 
tation should be based upon some mix of generic, problem-oriented, 
and diagnostic criteria. The day hospital has been described as an 
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PIOURI ISA. 

Admissions Critsria for Day Hospital Usad to 
Paollltata Raantry Into tha Community 

Justification for Admission 

A. The patient has Improved during Inpatient treatment but 
discharge to ambulatory care Is not yet possible 

BECAUSE 

B. Psychological functioning Is still too tenuous 

(e.g., patient has symptoms of serious depression, 
continued withdrawal, psychomotor retardation, or serious 
symptoms of thought disorder) and patient requires a 
structured treatment setting. 

OR 

0. Medication regime has not been staolllzed 

(e.g., medications appropriate to diagnostic condition are 
prescribed and have not successfully modified symptoms. 
Medication has been begun, but because of possible toxic- 
ity and/or problems with compliance, It must be given In a 
supervised setting.) 

OR 

D. Discharge planning is not complete or adequate alternative 
structured living arrangement is not available. 



PIQURC ISB. 

Contlnuad-Stay Critaria for Day Hospital 
usad to Paollltata Raantry 

Into tha Community 

Justification for continusd stay 

A. Treatment objectives have not yet been achieved 
(patient remains seriously symptomatic and unable to 
function In a less structured setting) 

OR 

B. Medication regime Is not stabilized 

OR 

C. Complications have occurred 

(e.g., drug side effects, serious environmental stress. 
Intercurrent Illness requiring diagnostic evaluation and 
treatment.) 

OR 

D. Discharge planning Is not yet complete 

(adequate community alternatives are not avail^aole or not 
yet In place.) 
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excellent treatment setting for borderline patients, who may re- 
quire intensive psychological and social rehabilitation but can 
seriously regress within an inpatient setting* Day hospital treat- 
ment programs require patients to return home nights and 
weekends and preserve functional capacity. Patients with a specific 
diagnostic label (borderline) or with a particular problem (excessive 
dependency needs) may thus be treated with social psychological 
therapies in order to both limit regression and increase functional 
capacity. Indeed, in return for maintaining their functioning, the pa- 
tients may have some limited dependency needs gratified within the 
day hospital. In addition, day hospitals serving rehabilitative ends 
frequently request the collaboration of family or other significant 
figures in the patient's life, and criteria should reflect this (figure 16). 

In this type of day hospital, continued-stay review is related to 
the individual's general level of functioning and capacity to par- 
ticipate in and benefit from specific therapeutic programs. The 
criteria should be constructed in such a way as to assess functional 
capacity. For example, prevocational assessment may help identify 
an individuaFs capacity to benefit from specific rehabilitative ser- 
vices. Continued stay might be related to completion of an evalua- 
tion process, participation in an ongoing rehabilitative program» and 
the availability of community resources. 



FIGURE 16 



Admissions Critsris for Day Hospitals Usod 
for Rshabllltstlon 



Justification for Admission 

A. The patient has a diagnosable and nnajor psychological 
disorder (e.g., see figures 2, 3, and 12) or is seriously 
synnptonnatlc (e.g., see figures 5 and 6). 

B. The patient is seriously debilitated and functionally linnlted 

AND 

C. Evaluation of the patient's psychosocial function has 
identified defects In social functioning, work perfornnance, 
and/or fannliy role for which rehabilitative therapies which 
require a structured environnnent are available. 
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CONCURRENT REVIEW OP 
AMBULATORY CARE 

Problems in review become increasingly complex as one moves to 
the ambulatory-care area where the volume of service may be ex- 
traordinarily high, duration of treatment relatively brief, and 
recordkeeping usually poor. A number of ambulatory-care review 
models have been developed. Almost all assume that admission cer- 
tification will automatically occur without prior authorization. Since 
a large number of individuals drop out of ambulatory treatment 
a^t3r one or two visits, duration-of-treatment review may be 
routinely scheduled for all who remain in therapy for the median 
number of visits identified as the norm within the particular 
geographical region. 

The emphasis on continued-stay review rather than admission 
certification is reasonable both in terms of restraining costs and ef- 
fectively utilizing services. Facilitating entry into ambulatory care 
may provide early intervention and prevent more restrictive and 
more costly forms of treatment. Additionally, the cost of reviewing 
an enormous number of cases of limited duration might well be pro* 
hibitive. Continued-stay review will place limits on the amount of 
treatment received, and, as with concurrent inpatient care review, 
will monitor the utilization of resources and restrain costs. 

At the Peninsula Mental Health Center, a private-practice- 
oriented CMHC, all ambulatory treatment is reviewed after six vis- 
its. Continued treatment must be justified to a committee of peers 
in a setting analogous to a clinical case conference. The criteria are 
implicit. The review process emphasizes time-limited treatment, 
with clear identification of treatment goals and the manner in which 
treatment is expected to accomplish change. Published reports 
(Luft, Sampson, and Newman 1976; Luft and Newman 1977) indicate 
that approximately two-thirds of cases presented for review are ap- 
proved. In about one-third of cases, modifications in the treatment 
plan are advised. These primarily emphasize reducing the duration 
of treatment. This review process has helped the CMHC hold down 
costs. 

Several ambulatory review models are closely tied to psychiatric 
diagnosis. The Manual of Psychiatric Peer Revietu"^ contains 
guidelines for reviewing ambulatory care activities. CHAMPUS and 
the American Psychiatric Association have also collaborated on 



^Prepared by the Peer Review Committee of the American Psychiatric Association in 
cooperation with the Joint Task Force on Diagnostic Criteria for Analyzability of the 
American Psychoanalytic Association and the Peer Review Committee of the 
American Academy of Child Psychiatry. 
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developing such criteria. In both cases it is assumed that admission 
certification will be routine. The primary review occurs when the 
median length of stay in treatment for a specific diagnostic group is 
reached. Criteria for review are explicit. 

Karasu and his colleagues (1977) developed a review system for 
psychotherapy which is rooted in a psychodynamic theoretical base. 
They first establish diagnosis and then review care in relationship 
to four problem areas: (1) manifest symptoms and psychological 
problems; (2) characterological problems; (3) family and social rela- 
tions problems; and (4) school, work, productivity, and creativity 
problems. 

In each of these areas, problems are specified and rated on degree 
of severity. Clinicians must present behavioral evidence for the 
severity of problems, develop a psychodynamic formulation, and 
design therapeutic interventions built around desired outcomes. 
The authors do not, however, develop any criteria for admission cer- 
tification, nor do they present any guidelines for continued-stay 
review. One might assume that duration of treatment within this 
framework would be related to regional norms. 

All of these approaches use criteria based upon a clinical diagno- 
sis. To our knowledge, no one has yet developed a comprehensive 
approach to defining explicit normative criteria for special prob- 
lems. For example, determining criteria related to the problem of 
child abuse might benefit from such an approach (see figure 17). This 
figure presents a number of criteria for the treatment of child- 
abusing parents and shows how the criteria could be transformed in- 
to a checklist. The checklist incorporates the criteria in a manner 
that facilitates abstracting data from the clinical record, thus easing 
the review and audit process. The example provides a sense of the 
logic involved in transforming the criteria into a form more suitable 
for chart review. 

Other problem-specific criteria could be developed in a similar 
manner. For example, areas of functional impairment could be iden- 
tified and appropriate treatment strategies prescribed. Problems 
with important family members might be approached through 
various psychological therapies including individual, family, or 
group treatment. Problems at work might be addressed by voca- 
tional testing and rehabilitation and by assessing the individual's 
ability to socialize and his job requirements for socialization. Once 
again, admission certification might be relatively automatic, and 
continued-treatment criteria could be related to problem definition 
and progress in treatment. 

In sum, for most ambulatory care, admissions certification will be 
automatic. Specialized treatment processes (e.g., psychoanalysis or 
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FIQURE 17 

A Checklist Incorporating Critoria for tho Ambulatory 
Troatmont of Child-Abutting Paronts 



Criteria 

The initial checklist Item identifies 
the problem being considered. 

The next group of Items spells out 
the Information needed to determine 
If criteria for the Individual treat- 
ment of an abusing parent have 
been met. 

The criteria are: 

1. The existence of a demonstra- 
ble clinical disorder 



Checklist items 



3a. 



WHERE 

The extent of abuse is relatively 
limited 



WHEN 

Provisions have been made to 
ensure that \t:j abused child is 
protected 



AND 

3b. Adequate 9.ocin\ supports are 
available tne ;amiiy 



AND 

3c. Specific Quidelines are estab- 
lished lor interagency inter- 
action 



CWas client(s) referred because of a 1 
history of abusi ng a child? | 

If YES, 



Is there evidence that the ciient(s) 
has a cllnicat condition (e.g., 
alcoholism, depression) which can 
bo expected to Improve with am- 
bulatory care (use of appropriate 
diagnostic criteria or generalized 
level of care criteria) and that this 
condition directly accounts for the 
abuse? 



Does the record indicate that abuse 
is relatively infrequent? Is abuse 
limited to a specific child rather 
than generalized to several children 
and/ or marital partner? 



Does tho record provide evidence for 
ongoing liaison with requisite legai 
agencies to protect the abused 
child? Has the child received appro- 
priatG medical and psychological 
evaluation and treatment. If In- 
dicated? If Indicated, has foster 
placement been accomplished? 



^ Does the record Indicate that social 
welfare agencies and/or extended 
family have been involved In pro- 
yidlngsu ppor t? ^ _ 

Does ^he record Indicate where re- 
sponsibility for treatment lies? re- 
sponsibility for protection of the 
child? Is the record clear about 
which responsibility has priority, 
and when? Is confidentiality ab- 
solute? If fiOt, does the lecord in- 
dicate that limits on confidentiality 
have been made clear to parent(s;? 
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various long-term rehabilitative treatments) may require admis- 
sions certification which demonstrate that the treatment modality 
is appropriate and necessary. Criteria for continued-stay review 
will reflect adequate problem formulation, therapeutic goals, and 
anticipated outcomes. They will also cover persistence of serious 
symptomatology and functional limitations, as well as the need for 
continued use of medical supervision and/or psychotropic agents. In 
addition, treatment cou?d be extended because of complications 
such as more severe symptoms, problems with medications, inter- 
current illness, or suicidal behavior. 

In a quality assurance program for ambulatory care, it is impor- 
tant to develop and utilize criteria which both qualify services for 
reimbursement and reflect the work and the values of the treatment 
facility. Most of the models for review are derived from medical- 
psychiatric approaches. Although little work i/\s been done to 
develop explicit criteria for the review of other approaches to men- 
tal health care, we have attempted to indicate that other strategies 
are possible. 
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aach. Finally, ''paar' ravlaw" Is da- 
scribad as a procass to assura quality 
of sarvica, monitor approprlata utiliza- 
tion, and rastrain cost. 



KEY TOPICS 



• The formulation of normative and empirical 
criteria and the limitations of each 

• The development of implicit and explicit criteria 
as approaches to analyzing the quality of care 

• The need to evaluate the utility and validity of 
criteria 

• Group standards 

• The process of peer review 

• Goal attainment scaling 

• The role of the review coordinator 
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CHAPTER THREE 

CRITERIA: 
Development and 
Application 

NORMATIVE VS. EMPIRICAL 

According to Donabedian's usage (1966), criteria may be either 
nomaftt;^— derived from the opinion of professionals— or empirir 
ca2— based upon the actual practice of professionals. In either in- 
stance^ criteria reflect the consensus of clinicians on the state of the 
art at a given time. 

Normative criteria are formulated on the basis of professional 
opinion or, more rarely, clearly validated scientific information 
around an ideal of what represents excellence in clinical practice. A 
number of methods have been used to develop such criteria. These 
include the judgment of highly qualified practitioners, curcfnl 
review of textbooks and standard publications, development of ex- 
pert panels, and polls of practitioners. Since such opinions, notions, 
and pronouncements are likely to derive more from a body of 
legitimate knowledge and values than from actual practice, their 
validity depends upon the extent of agreement concerning data and 
values within a particular profession. For example, in a study of 
views about prescribing antibiotics for childhood respiratory infec- 
tions (Wagner et al. 1976), general practitioners tended to see more 
indications for their use than did pediatricians. Pediatric specialists 
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in infectious diseases required the most intensive evaluation before 
prescribing them. As a result, questions have arisen about the 
relevance of normative standards developed by one group to the 
practice of another. Dissatisfaction has further been expressed 
about applying to clinical settings standards or criteria developed in 
academic centers. In a similar manner, the development and use of 
the Diagnostic and Statistical Manual III (DSM III) (American 
Psychiatric Association 1980) by American psychiatrists has led to 
some problems. The DSM III clearly specifies criteria for 
establishing diagnosis and is generally applauded for its aims and 
its scope. However, psychiatrists in other nations note that some of 
the terms in the volume have different meanings in their nations 
and, further* that some clinical conditions identified as of impor* 
tance in their nations are not categorized in the volume. Some 
members of other professional groups identify the use of this 
diagnostic scheme as casting their work within a medical context 
and bemoan the absence of an accepted nosologic system that might 
more appropriately capture the essence of their work. 

Empirical criteria are formulated from statistical analysis of ac- 
tual patterns of care. They can be used to compare care in one set- 
ting with that in another or with statistical averages obtained from 
a number of similar settings. Since such criteria reflect demonstra- 
ble levels of care» they are likely to be more creditable and accept- 
able to practitioners at large and less subject to criticism as ideal- 
ized constructs. There is, however, one major limitation to the use of 
empirical standards. Although the care-giving process may appear 
to be adequate compared to other situations, it can still fall short of 
what is attainable through the full application of current knowledge. 
Thus, it seems advisable to have empirical observations serve as 
criteria only if a normative element of judgment is added. Ideally, 
both normative and empirical sources should be drawn on in evolv- 
ing standards of care. 

Theoretical position as a factor 

Criteria based upon diagnoses envision emotional and mental 
distress within a medical-psychological framework. Criteria for en- 
try into psychoanalysis (admission certification) use the language 
and concepts of that theory to assess appropriateness for treatment 
(American Psychiatric Association 1976). Thus» psychoanalysis is in- . 
dicated for patients in each DSM category where chronic symptoms 
predominantly reflect "intra-psychic pain" and "arrested or deviant 
development** which are not permanently helped by other forms of 
treatment, and who fulfill ''criteria for analyzability . . . which in- 
clude the capacity to form» maintain, and eventually relinquish an 
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adequate therapeutic alliance." This may be "evidenced by adequate 
potential for introspection, sublimation, self-object differentiation, 
and internal object constancy." Explicit criteria might equally well 
be developed for the use of behavior therapies, biofeedback, and 
nondirective Rogerian treatment. In any case, the criteria sets 
should describe indications for treatment, exceptions, critical 
diagnostic and therapeutic services, and how length*of-stay in treat- 
ment is to be determined. 



EXPLICIT VS. IMPLICIT 

Explicit criteria specify predetermined elements of care which 
apply to members of an entire group. The group may be character- 
ized by diagnoses such as schizophrenia, alcoholism, or tardive 
dyskinesia: by problem specificity such as child abuse, suicide, or 
rape: or by generic treatment condition such as entry into inpatient, 
day, or ambulatory treatment or the use of psychopharmacological 
agents. In some situations, criteria may be based upon socio- 
demographic characteristics, such as social class, race, or age group. 
They may be normative or empirical. These criteria are group stan- 
dards evolved from examination of community practice, established 
by an expert panel, or based upon research data. Such an approach 
is useful in comparing an individual's clinical care to community 
standards or ideal treatment. 

Implicit standards allow change to be assessed on a case-by-case 
basis. They constitute an individualized approach to analyzing care 
and are the criteria most frequently used in reviewing a clinical 
chart or commenting on the quality of care during supervision or 
case rounds. Implicit criteria are most useful when criteria for a 
group are hard to define, or when group definition is less important 
than patient-clinician interaction. They tend to reflect the "art of 
practice" and are based upon the clinical experience of an individual 
practitioner, or group of practitioners. Implicit standards are usu- 
ally not written down. 

In general, clinicians tend to feel that "clinical judgment" is most 
useful because the art of their practice is built around a constant 
awareness of what is unique about each case. Reviewers, particu- 
larly insurers and accrediting bodies, insist upon explicit criteria. 
Quality assurance programs will also tend to rely upon review based 
on explicit criteria. 

Implicit criteria, with difficulty, can be made explicit to provide 
an organized review of care. Kiresuk's Goal Attainment Scaling 
(Kiresuk and Sherman 1968) has been utilized for this purpose by 
forcing the clinician to define the basis of his judgment. In Goal At- 
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tainment Scaling, individual treatment goals are set for a patient's 
various problem areas and best possible outcomes and other points 
along a continuum are defined. Care provided the patient is 
evaluated in terms of goals defined at admission either by the clini- 
cian alone or through some interaction of client and clinician. The 
approach has been widely utilized in CMHCs in conjunction with 
problem-oriented records. An example combining problem-oriented 
criteria and Goal Attainment Scaling is provided in figure 18. 

Goal Attainment Scaling has been used primarily to assess the 
outcome of services provided to individual patients. Since the goals 
vary from case to case, one cannot examine treatment in relation to 
predefined explicit criteria. The technique, however, could be used 
as a first step in criteria development. Through a careful examina- 
tion of the treatment provided to numbers of individuals, informa- 
tion about specific types of problems or client groups can be 
abstracted in order to develop explicit criteria reflecting group 
standards. 



TESTING AND VALIDATING CRITERIA 

While information derived from both normative and empirical 
sources can be used to formulate criteria, the criteria ultimately 
reflect normative judgments. This situation poses several problems 
in the mental health area. Mental health practitioners tend to prefer 
particular therapeutic modalities, choose to deal with certain kinds 
of patients, and show interest only in specific problem areas, ex- 
cluding others. These biases about treatment strategies and 
theoretical positions are compounded by a lack of consensus regard- 
ing basic definitions of health, mental health, and mental illness. 
Given this reality, the criteria adopted should be periodically tested 
and validated. If this does not occur, the criteria may become reified 
"laundry lists" that constrain clinical practice without assuring 
clinical excellence. 

In view of this circumstance, retrospective review processes (see 
Chapters Four and Five) should be used to regularly evaluate the 
utility and validity of criteria. As retrospective review mechanisms, 
clinical care evaluation studies and profile analyses provide impor- 
tant vehicles for determining whether actual practice conforms to 
group standards and for testing whether the group sUndards ade- 
quately identify problems in the delivery of care. An excellent ex- 
ample of the use of clinical care evaluation studies in refining 
criteria was provided by Kirstein and Weissman (1976) in their 
review of criteria for hospitalization of suicidal patients. They were 
able to reduce a comprehensive list of behaviors to those few that 
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PIQUM 18 

Prebl«m-Orl«nUcl CrIUrIa D«v«lopm«nt Using Goal Attainment Scaling 



PROBLEM: 

Subjective: 



Objective: 



Assessment: 



Plan: 




' 7 f00l down In fftt dumps §nd tlr^d §11 of ffta 
lime," Difficulty f§IHng es/tep nightly, 9 lbs, 
weight loss during psat 12 months, OccsalonBl 
suicidal thoughta. 



Sad facias; tearful during Intervlaw, Exhibits 
psychomotor retardation, 



65 year old, dates onset of dyaphoria to death 
of wife IB months ago. Became tearful In 
talking about her, 



1) Begin antldepreasant meds, 

2) Ixiwk Individual therapy 

3) Encourage Involvement In activities outside 
of the home. 



QOAL AND QOAL WEIGHT. 



most unftvortbte 
treatment outcome 
thought likely 

-2 


Becomes anergic, withdrawn and preoc- 
cupied to the point that he can no longer 
care for self. Despondency leads to active 
suicidal thoughts. 


less than expected 
success with 
treatment 

-1 




expected level of 
treatment success 

0 


Occasional periods of sadness and tear- 
fulness, particularly around anniversary 
events. Appetite returns. Only rare difficul- 
ty falling asleep. Can care for self, but re- 
mains socially disengaged. 


more than expected 
success with 
treatment 


No vegetative aymptoms, aulcldal Idea- 
tion, bouts of tearfulneas. Sad ort occa- 
sion but no Moathv. Level of social In* 
teractlon returns to prior state. Sees 
friends at Ieaat2x/wk, Involved In church 
and business as before wlfe*s death. 


best anticipated 
success with 
treatment 

-^2 
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are most important for determining whether to hospitalize suicidal 
patients. 

CAVEATS RELATED TO PEER REVIEW 

The review coordinator examines indicators for admission to 
treatment or continued stay in the light of criteria developed by 
peer groups. The coordinator has only the power to determine 
whether decisions abouC care meet pre-established criteria. Those 
cases where deviations exist must be referred for peer review. 

The term ''peer review" implies that one's colleagues, one's 
equals, will cooperatively examine clinical practices in order to 
assure the quality of service, monitor appropriate utilization, and 
restrain cost. In the professions, peers are defined as members of 
the same discipline in order to maintain professional self- 
determination. 

In many mental health settings there is serious confusion be* 
tween peer review and administrative control issues. The need for a 
peer review process arose specifically from the role of physicians in 
general hospital settings. The physician serves as a relatively 
autonomous professional in most hospitals. He is paid not by the 
hospital, but directly by the patient. He has a powerful impact upon 
the hospital, since through his admissions practices he generates 
revenue for the hospital and commits hospital resources. Peer 
review practices require accountability mechanisms for physician 
behaviors. Significantly, physicians v/ho work as hospital employees 
have tended to insist upon equivalent autonomy, as have other pro- 
fessionals. Institutions generally are loath to give up control to 
those who are already clearly accountable within institutional 
monitoring structures (e.g., supervision or clearly defined team 
structures with identified leadership). In fact, institutions may tend 
to subvert peer review practices in order to assert further ad* 
ministrative control over practice. Thus, added to issues of peer 
definition by discipline is ^he institutional wish to define account- 
ability hierarchically. 

In some settings, clinical administrative supervision is inappro- 
priately identified as peer review. This stance leads either to 
subversion of institutional goals, as practitioners use these proc- 
esses to define priorities and institutional policies, or, more com- 
monly, to institutional constraint upon practice, as the institution 
adopts criteria and standards which limit clinical options and profes- 
sional autonomy. 

Peer review as identified in PSRO legislation is designed to 
preserve professional self-determination through professional 
monitoring of utilization* quality* and cost. It seeks to correct prob- 
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lems in practice through careful monitoring, persuasion, and educa- 
tion. Peer review is not hierarchical accountability. 

The processes of review influence decisions about care and must 
be appreciated. Peer reviewers must live within the context of their 
professions. They will thus tend to show latitude in regard to devia- 
tions from practice as long as those deviations do not lead to patient 
care that is overtly bad. However, the process of recording informa- 
tion and examining the record will assure that clearly aberrant pat- 
terns of care are recognized and subject to review. When peers 
within a clinical setting have participated in defining criteria, or at 
least have agreed to accept criteria, they can be held accountable 
for their practices by their peer group. In this process, practitioners 
whose work is seriously aberrant will be identified, and mechanisms 
will be available for corrective action. 

The reluctance of clinician reviewers to criticize the work of peers 
may be modified through effective interaction of the review coor- 
dinator and the clinician reviewer. Review coordinators have been 
able to focus the attention of clinician reviewers so that when admis- 
sions are being justified or extensions given which do not meet the 
criteria, the peer reviewer is committed to careful re-examination 
before further deviations from criteria are accepted. 

Most often, the process of peer review and correction will be one 
of mutual respect, gentle persuasion, and education. When specific 
sanctions are required, they should be based upon documented or 
repeated deviations from accepted practice and should reflect a for- 
mal action of the relevant peer group. 

The importance of confidentiality in this process must be em- 
phasized. Records of peer review activities must be kept separate 
from case records. Access to records must be strictly limited by for- 
mally prescribed regulations. 

The goal of peer review is assuring quality, and disciplinary ac- 
tions occur only after confidential communication from peer to peer 
about identified deviance and efforts at education and correction. 
Professional practitioners cannot be expected to participate volun- 
tarily in a program in which every suspected deviation from criteria 
is subject to public scrutiny. Federal regulations recognize this 
problem and in the PSRO process call for security of records (Cur- 
ran 1978). 
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THE RETROSPECTIVE 
REVIEW PROCESS— 
Profile Analysis 

Concurrent review activities focus on individual patients. The 
question of whether treatment or continued care is necessary is ad- 
dressed on a case-by-case basis. A single episode of care is the point 
of reference. The review occurs while a person is still in treatment, 
and the outcome can have an immediate impact on the course of 
treatment. 

Retrospective review activities, on the other hand, focus on the 
delivery of care to a large number of patients. While the data used 
in the retrospective review may be obtained during treatment, the 
analysis is usually conducted after discharge. The review is not in- 
tended to produce immediate results, but rather to promote a more 
effective and efficient use of available resources in a manner consis- 
tent with patient needs and professionally recognized standards of 
care. At present, two methods of retrospective review, profile 
analysis and clinical care evaluation studies are receiving the 
greatest attention. 

PROFILE ANALYSIS 

A profile is a summary that presents selected information so that 
patterns of care can be identified and analyzed. An individual profile 
displays information on a single patient or clinician. When the data 
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are aggregated by service unit or by categories of patients or clini- 
cians, they comprise an institutional profile. Profiles from one in- 
stitution can be compared with profiles of other institutions in order 
to assess performance. 

Profile Development 

The source material for profile development consists of data 
routinely collected on all patients and readily obtainable from the 
record. These data include information that (1) identifies patients, 
clinicians, and service units; (2) indicates the nature of the problem 
for which treatment services are offered; and (3) specifies the 
disposition and outcome of treatment. When computerized records 
are available, data may be obtained directly from the clinical record. 
Otherwise! clinical staff can abstract the requisite data from the 
record at the time of a patient s discharge. 

Figure 19 illustrates a form for abstracting data from the record. 
Profiles can then be constructed either manually or by entering the 
data from the abstract into a suitably programmed computer. 

The task of constructing an abstract can be facilitated if special 
forms are used for admission certification and continued-stay 
review (see sample forms in figures 20 and 21). These forms are com- 
pleted by the clinician or the review coordinator during the concur- 
rent review process. They serve two purposes: (1) providing ready 
access to information essential for determining the need for treat- 
ment or continued care and (2) providing the information required 
for profile development. Although for some profiles it may be 
necessary to go back to the record and abstract supplemental data, 
careful preplanning of review forms can save a great deal of time in 
the collection of evaluative information. 

A profile is usually presented in the form of a statistical report of 
selected data on patients, practitioners, or service units in relation 
to specific questions concerning service delivery. For example, the 
data may be aggregated by clinicians in order to compare dif- 
ferences among clinicians in treating patients of a certain age with a 
particular diagnosis. Alternatively, the data may be aggregated by 
service units in order to compare patterns of care provided patients 
with similar diagnoses. The potential formats for profiles are 
limited only by the nature of the data available for profile develop- 
ment and the answers wanted about patterns of care (See figure 22). 



Profile Analysis 

Tb process of comparing patterns of care among clinicians or pa- 
tien comparing current patterns of care with those of a previous 
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PIQURE 19 

An Example of mn Abstraet to bo usod for Profile Dovolopmont 



3 

(D 

8 
•o 

(D 
O 

< 
CD 

13 
CD 
< 



-0 
3 

> 

CO 



1. CASE NUMBER; / / /. 

2. SERVICE UNIT: . / 

3. PRIMARY CLINICIAN: I .^^J 

4. ADMITTED: . .../ _.„./ 

5. LOS 



J / 



DISCHARGED: /. 



Inpatient days = = 
PH Days = = 

OPD Visits = = 



6. LEGAL STATUS: 



informal = = 
volun = = 
involun = = 



7. FINAL DIAGNOSES: 



8. AGE: I 
10 



9. SEX: = = M - = F 
ETHNIC GROUP: == white == black 



= =hispanic 
= =:amind == oriental other 



1 1. MARITAL STATUS: = = nev mar = = mar =: = remar 

= = sep = = div = = wid = = unk 

12. HOUSEHOLD COMPOSITION: =: Ivg alone = = with spouse 

= = with parents = = with children = = with sibs 
= =with oth rela = =with others = =in instllu 

13. WEEKLY FAMILY INCOME (Ave net dollars): 

= = welf = :i <$50 = =$50-99 = =$100-149 
= = $150-199 = = $200-299 = = $300 + 



14. INDIVIDUALS ON FAMILY INCOME: I ? 

15. PAYMENT STATUS: ==workmcomp ==bluecr 

= =comminsur = = pv == medicare == medicaid 
= =govt agen = =vol char - = other 



16, DISCHARGE STATUS: == with approval 

= = without appro 
= 5= trans 

17. COMPLICATIONS: = = none = = present 



18. CONSULTATIONS; = = none = =med = =sur9 

= = neuro = = other 

19. investigative services: 

/lab7 /radiology/ 

= = cbc = = rasp 

= = urn = = ens 



20. 



/FUNCTIONAL/ 

= = psych test 
= =EKG 
= =EEG 



THERAPEUTIC SERVICES: 

/MEDICATIONS/ 

= = maj tranq = = 

= = anti dep = = 

= = min tranq = = 

= = sedative = = 



/OTHER/ 



21. REVIEW STATUS: = =adm cert appr = -adm cert disap 

= = cl rev app ==01 rev dIsap 
= = csr appr = = csr disap 

= = cl rev app = = cl rev disap 
= =:conf appr = =conf disap 
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An Example of a Form for Use In Admission Certification 



NAME: 



_DOB: 



SERVICE UNIT: 



J /_ 



PRIMARY CLINICIAN: 



CASE NO*. 

J / 



DIAGNOSTIC IMPRESSION: 



-LEGAL STATUS: = = Informal 
= =volun 
= = invol 



CLINICAL EVIDENCE IN SUPPORT OF DIAGNOSIS; . 



INDICATIONS FOR ADMISSION: 
= = actual or potential danger to self 
= = actual or potential danger to others 
= = behavior Intolerable to client, family, or com- 
munity 

= = removal of patient from psychonoxlous en- 
vironment 

= = Impairment of social, familial, or occupational 
functioning 

= = supportive measures have been unsuccessful 
In halting or reversing the course of the mental 
disorder 

= = medications or drugs on which the patient Is 

dependent must be withdrawn 
= = impaired reality testing accompanied by dis* 

ordered behavior 
= = condition other than mental disorder requires 

hospital care, but psy^hofogical components 

cannot optimally be handled on other services 
= = inability to care for self and absence of social 

supports 

= =no alternative resources availaole 

= = need for 24 hour observation to clarify diagno* 

sis or to evaluate condition In order to modify 

treatment procedures 
= =need for specialized treatment under 24 hour 

supervision 



ELABORATE & EXPLAIN 



REVIEWED BY. 



.ON / L 



PHYSICIAN REVIEW ON 
= = approved 



BY. 



= = approved 

= = more information required 
= = physician review required 



= ^disapproved = = conference required 



CONFERENCE RESULTS: . „ 



ERLC 



72 



Retrospective Review— Profile Analysis 

FIQURI 21 



61 



A Form for RoquMtlng IxUndtd Duration off Stay 



Name: 



DOB: 



Admission Date: 
Diagnosis: 



J Case #: 

Review Date: L 



Investigative Services Performed: 

LABORATORY RADIOLOGIC 



XBC 
.STS 

.Urinalysis 
^toxicology screen 
.other, specify 



.chest/respiratory 
.skull 

..other, specify 



FUNCTIONAL 

med h /phys xam 

psych n^/ment status 

psychological tests 

EKG 

EEG 

other, specify 



Therapeutic Services Provided: 
IV!EDICATIONS 



OTHER 

Nursing care 
ECT 

Casework with family 

OT 

RT 

Art Therapy 
Music Therapy 
Milieu Therapy 
Voc Counseling 
Genetic Counseling 
Ind Psychotherapy 
Gp Psychotherapy 
Family Psychotherapy 
Couples Psychotherapy 
Behavioral Therapy 
Other, specify 



Consultations Obtained; 
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PIQURM21 (Cont.) 



A Form for Roquosting Ixtondod Duration of Stay 

Complications (list type and date): 



= = persistence of disabling symptoms 
= =: concomitant physical Illness 
= = adverse reaction to medication, ECT 
= = hospital treatment career demonstrat- 
ing lack of discharge readiness, e.g., 
elopement, suicide attempt, etc. 
= = major unanticipated life stress 
= = environmental factors of sufficient In- 
tensity and severity to Immediately 
cause decompens^ation 
= = Initial treatment goals not realized 
= = treatment program had to be modified 
= = discharge difficulties related to fam- 
ily/community rejection 
=:=dlscharge difficulties related to 
absence of appropriate resources in 
the community 
= = planning for alternate care not com- 
plete 

= = awaiting economic support arrange- 
ments 
= = transfer pending 
= = other, please specify 



Estimate of additional days of hospital level care required: 



= = more Information required 

REVIEWED BY ON / / : = = physician review required 

= = approved 

= = approved 

PHYSICIAN REVIEW ON BY : =: = disapproved 

= = conference required 



Discharge Is not yet possible because: 



EXPLAIN 



CO.NPERENCE RESULTS: 
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ExamplM of ProfiU Displays 



SVC 
UNIT 



131 



132 



133 



SVC ALL PTS 
UNIT 131 OlSCH 

PRIMCLINII LOS 



abc 



10 4.3 



ALL PTS 
DISCH 
» LOS 



SO S.5 



22 la.o 



22 27.5 



EMERQ. 



24 



COMPL. 
f 



10 



CONSUL 
t 



12 



AQE 

~r5o — 

f LOS 



> w 
n LOS 



15.1 12 10.3 



15.1 



2B.e 



PAY^'ENT STATUS 
Work 

n 



.np 



-A summary profile- 
- by service unit - 



BENJAMIN RUSH CMHC 



DIAQ 



SCHIZO 



AFF DIS 



NEURO 



TRANS 
SIT 

PERS 
DISOR 



1 



139521 



1 i 
X 



18 



167345 



27 



106459 



15 



67 



196723 



12 



34 



198734 



17 



Profile displayed as a- 

- listing of patients by - 

- primary clinician by - 

service unit 



169543 



CASE NO LOS ADM EMEQ LEG STAT AGE SEX 





198756 


2 


Y 


X 


22 


M 



Blue Cross 
* LOS 



25 7.2 



10 18.8 




time, and comparing patterns ot care between institutions or ser- 
vice units is referred to as "profile analysis." This technique for 
surveying patterns of care is used to monitor service delivery 
trends and identify deviations from expected or desired practice. 
Analyses can be used: 



1. To focus concurrent review on problem areas. For ex- 
ample, a profile may reveal that admission rates and 
lengths of stay for patients with a diagnosis of depres- 
sive neurosis treated on an inpatient unit of a commu- 
nity mental health center fall within the norms for 
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that condition in that region. This could prompt the 
reviewers to grant automatic certification of admis- 
sion for this diagnosis, using the profile system 
periodically to monitor performance. Conversely, a 
profile might show abnormally high lengths of stay for 
adolescent patients with the diagnosis of depressive 
neurosis. This could lead the institution to intensify 
admission certification and continued*stay review ef- 
forts for this group of patients. Age*specific criteria 
could be developed, and a lOO-percent review of all pa- 
tients admitted undertaken, 

2. To establish priorities for clinical care evaluation 
studies, A comparison of service units might reveal 
that patients with a diagnosis of schizophrenia treated 
on Ward A as opposed to Wards B, C, and D have a sig- 
nificantly Linger LOS and a greater number of com* 
plications during their hospitalization. Such informa* 
tion may suggest the need for more indepth inquiry 
concerning the character of care provided patients 
with the diagnosis. The clinical care evaluation study 
provides an appropriate vehicle for such an inquiry. 

3. To aid in monitoring the impact of an institution's 
review activities. For example, the results of the 
clinical care evaluation study suggested above raised 
questions about the use of major tranquilizers on 
Ward A, where the initiation of psychotropics was 
delayed and dose levels were felt to be homeopathic. 
Based on the study, a 100-percent screening bench* 
mark for major tranquilizer use in the inpatient treat* 
ment of patients with diagnosis of schizophrenia was 
established. A continuing education seminar on psy* 
chopharmacology was also instituted. To determine 
whether the actions led to any measurable shift in the 
patterns of care initially observed, a second profile 
analysis was conducted some 6 months later. In the 
comparison of the four treatment units, no major 
variation in the length of stay was found, and the 
length of stay for all units was consistent with 
regional norms. The incidence of complications in 
Ward A had decreased significantly since the first 
profile analysis. On the basis of these analyses, it was 
concluded that the corrective actions taken were 
associated with acceptable change in the pattern of 
care within the institution. 



76 







f 


CHAPTER FIVE 




THE RETROSPECTIVE 




REVIEW PROCESS— 




Clinical Care 


• 


Evaluation Studies 




This ohaptor •xptalns r«tro«p«otlv« 
review oonduotod through Clinical Car* 
■valiMtiM (CCll atiKllM. Thaaa atudlas 
arf iMainpta to Mtabllth paramatara of 
latiWiwteta aHnloal ooitduot in ralatlon to 
m prihiawi, pepwietlott, or program that 
la llie laplo af hiqulry. Tha authora Idan- 

wMdb can ha atwdlad, axplain how to 
aaiaat aUMly toploa, and aatabllsh 
eritaria and atandarda for CCI atudlas. 




65 

mi 



KEY TOPICS 



• The nature of the Clinical Care Evaluaiion study 

• Organization of CCE studies 

• Objectives of the CCE studies 

• Implementation of CCE studies 

• Uses of CCE studies 



CHAPTER FIVE 



THE RETROSPECTIVE 
REVIEW PROCESS— 
Clinical Care 
Evaluation Studies 

Clinical Care Evaluation (CCE) studies are a form of retrospective 
review in which an indepth assessment is made of a particular prob* 
lem or set of problems to determine whether patients are receiving 
the type of care defined by an institution as appropriate and ade- 
quate and whether the outcome of care is of an acceptable level. 
Generally, these studies focus on an identified or suspected problem 
area, cover a short period of time, and deal with the care provided 
by a number of practitioners to a number of patients. The objective 
is to provide information on the process of care and performance of 
clinicians that is sufficiently detailed and definitive to be used for 
prescribing interventions or changes that will benefit patient, in- 
stitution, and community. The steps in a CCE study include: 

1. Identification of components of care to be studied. 

This step involves the selection of a component of 
care of sufficient importance to warrant indepth 
study. A topic may be suggested by profile analysis or 
concurrent review or by critical issues raised by staff, 
specialty societies, or community board. 
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Study topics might concern the care provided pa- 
tients with a particular diagnosis or problem or they 
might be therapy-centered. For example, the infre- 
quent use of group therapy in an outpatient setting 
could be questioned. What are the criteria for referral 
to a group? Are there identifiable differences between 
persons referred to group and other forms of outpa- 
tient therapy? Do administrative procedures facilitate 
or inhibit the referral process? What kinds of group 
therapy are offered? Who seems to benefit from group 
therapy? 

Similarly, diagnostic procedures could be the sub- 
ject of inquiry— the use of psychological testing for 
patients with a diagnosis of minimal brain dysfunction 
or the workup of patients being considered for ambu- 
latory electroconvulsive therapy, for example, Utiliza- 
tion practices could be examined. Are the clients uti- 
lizing a program representative of the social demog- 
raphy of a service area? Does movement from one 
level of care occur when indicated? Studies may con- 
centrate on administrative issues, such as Incident 
Reports, the organization of emergency services, or 
problems of scheduling and reporting consultations 
for laboratory and X-ray studies. Treatment outcomes 
could also be a topic of inquiry. 

Since the range of topics is nearly infinite, every ef- 
fort should be made to select study areas on the basis 
of importance, visibility, adequate sample size, and 
probable utility of results in formulating recommenda- 
tions for change. 

2. Establishment of criteria and standards for the 
study. 

Unlike clinical research that seeks to determine 
whether treatment A is more efficacious than treat- 
ment B, clinical care evaluation studies look at 
whether the process of care contributes to or 
diminishes the assumed efficacy of treatment ser- 
vices. CCE studies are designed to answer questions 
such as: Are patients receiving the appropriate type 
of care? Are treatment outcomes at an acceptable 
level? Does the organization and administration of 
care enhance the efficiency of treatment without 
detracting from its effectiveness? To answer these or 
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other questions relating to the study topic, bench- 
marks must be constructed which identify efficacious 
procedures, optimal outcomes, or ideal organization. 
In other words, criteria are used to measure the ex* 
tent to which the actual delivery of care conforms 
with the optimal delivery of care. 

The specificity of criteria required for CCE studies 
should be of a higher order than that required for 
screening criteria used in concurrent review. If the 
study topic, for example, involves the appropriate use 
of psychotropic medications in an ambulatory setting, 
the criteria might specify effective dose ranges, drug 
interactions which may cause serious symptoms* or 
the relationship between drug class and diagnosis in 
order to determine the appropriateness of pharmaco- 
logical interventions. The criteria can be incorporated 
in a checklist, such as the example in figure 23, which 
facilitates abstracting the required information from a 
chart. 

In other instances, a population-specific focus might 
be adopted. A CCE study on the outpatient treatment 
of adolescents, for instance, began with the assump- 
tion that a therapeutic intervention could be judged 
adequate only it parents were actively involved. 
Criteria were then developed stipulating the cir- 
cumstances under which exceptions to parental in- 
volvement could be made. For instance, parents could 
be excluded if the adolescent's life situation was not 
chaotic, the adolescent was an emancipated minor, or 
the clinician judged that parental involvement during 
the initial evaluation would preclude the development 
of the therapeutic alliance. 

As these examples indicate, the criteria used in 
clinical care evaluation studies attempt to establish 
the parameters of legitimate clinical conduct in rela- 
tion to a particular problem, population, modality, or 
program. The criteria themselves can be adopted from 
criteria sets developed by major national specialty 
societies. They can reflect the opinion of experts as 
noted either in textbooks or journals or be based on 
evidence from clinical research studies. They can also 
be developed from aggregate data depicting patterns 
of care within a particular institution. Since regional 
variation exists in treatment practices, the availabil- 
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FIGURE 23 

A Format for Abstracting Information on Psychotropic Drug Uss for a CCE Study (Based on OSM 11) 



Does the chart indicate the following: 

a. nannes of nnedication(s) 

b. dosages 

c. side effects or absence thereof 

d. efficacy or absence thereof 

2. If nnedlcation was prescribed and adequately recorded, was it: 

a. a nninor tranquilizer? 

If YES. was the diagnosis alcohol psychosis, neurosis, personality 
disorder, sexual deviation, alcoholism, drug dependence, 
psychophysiologic disorder, special symptoms not elsewhere 
classified, transient situational disturbances, nonpsychotic organic 
brain syndrome with alcohol or social malajustment? 

b. a major tranquilizer? 
If YES. was the diagnosis psychosis associated with organic brain 
syndrome, schizophrenia, major affective disorder, paranoid states, 
or other psychoses? 

c. an antidepressant? 
If YES. was the diagnosis involutional melancholia, manic depressive 
illness, depressed type (or circular type, depressed), other psychosis, 
or depressive neuroses? 

Was a single generic variety of antidepressant given to the patient tor 
more than 8 months? 

If YES. chart should be subject to review. 



4. Has the patient received the same medication for 
longer than 3 months? 

If YES, do the total daily dosages prescribed exceed: 



Valium 


20 mg 


haldol 


15 mg 


librium 


40 mg 


navane 


20 mg 


miltown 


1200mg 


thorazine 


400 mg 




mellaril 


400 mg 


elavil 


150 mg 


trilafon 


32 mg 


tofranil 


200 mg 


stelazine 


30 mg 






prolixin 


10 mg 



If YES, chart should be subject to review. 

Has the patient received the following medication in 
total daily dosages not exceeding those indicated for a 
period of more than 6 months? 

Valium 5 mg 

librium 10 mg thorazine 50 mg 

miltown 400 mg mellaril 50 mg 

elavil 50 mg 

tofranil 50 mg 

If YES, chart should be subject to review. 
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Adapted from the Chart Review Checklist of the Connecticut Mental Health Center, New Haven. Connecticut 
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ity of resources, and the character of client popula- 
tions being served, these issues should be taken into 
account in formulating criteria. However, clinicians 
responsible for the delivery of care shou'd participate 
in selecting the final criteria. Involving those persons 
whose work is being judged in the selection of criteria 
usually makes the results more readily accepted. 

3. Design study and information requirements. 

The study designer must designate a study site; 
specify sample size and the characteristics of the 
population to be studied; select the sources of informa- 
tion and instruments; determine whether data will be 
collected prospectively, retrospectively, or both; in- 
dicate data-collection procedures; and select the data- 
processing mechanisms to be used. 

Much of the data used in CCE studies will be ob- 
tained from the chart. Once study criteria are estab- 
lished, therefore, it is important to develop an instru- 
ment for abstracting material from the record. An 
abstract allows for a rapid and accurate presentation 
of data related to the problem being studied and helps 
to ensure the collection of all necessary data. 

In some instances, however, CCE studies will use 
data sources other than the chart. Since this informa- 
tion is not routinely available, the decision invariably 
implies a prospective design. Whether one collects in- 
formation at time of admission, discharge, or foUowupi 
the resource requirements for such a study will be 
greater than when all data are obtained from the 
record. Numerous instruments have been developed 
to measure clinical status, social adjustment, and the 
like that can be helpful in prospective studies of this 
type. Examples are provided in figures 24-27 (pages 
74-95). For a more exhaustive inventory, the reader is 
referred to Hesource Materials for Community Mental 
Health Program Evaluation (Hargreaves et al. 1979). 

4. Collect and present data. 

The collection of data and the organization and 
presentation of the material should be done primarily 
by clerical and administrative personnel, since these 
tasks involve mainly tabulation: summarization, and, 
where appropriate statistical analysis. Once tabu- 
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lated, the results are presented to the Quality 
Assurance Committee. At this point, the study con- 
sists of ''facts** alone. 

5. Analyze data and prepare report. 

In the next step, findings are reviewed by the Qual- 
ity Assurance Committee. The Committee's analysis 
and discussion are aimed at developing conclusions 
leading to the formulation of concrete recommenda- 
tions for change. The ''facts/* conclusions, and recom- 
mendations comprise the heart of a study report. In 
preparation of the report, it is important to bear in 
mind how Lhe results can be used: 

a. To monitor the effectiveness of admission certi* 
fication and continued-stay review and identify 
areas where concurrent review processes should 
be instituted or intensified; 

b. To identify the needed changes in the organiza- 
tion and administration of care in order to 
assure a more effective and efficient response to 
the needs of users and potential users of ser- 
vices; 

c. To develop curriculum and monitor the effec- 
tiveness of educational activities aimed at cor- 
recting identified problems relating to the deliv- 
ery of care; and 

d. To provide information that will allow judg- 
ments regarding the adequacy of existing 
criteria, norms, and standards and the develop- 
ment of new criteria, norms, and standards. 

The objective of the study is to monitor the delivery 
of service, identify deficienci<^s in the process and out- 
come of care, determine the causes of these deficien- 
cies, and develop a corrective plan. Depending on the 
nature of the deficiency identified, the plan may in- 
volve organizational or educational interventions. 

6. Distribute study and provide followup. 

The study report, including its recommendations, 
should be forwarded to those groups and personnel 
specified in the written utilization review plan as 
described in Chapt r Eight and to any others directly 
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concerned with the subject and recommendations* At 
a reasonable time after corrective actions are com- 
pleted, a re-evaluation should be undertaken to assure 
that appropriate changes have occurred. This follow- 
up should be a brief study of the identified problem or 
a profile analysis. Technically a clinical care evalua- 
tion study is not complete until this final step has been 
accomplished. 



REFERENCES 
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munity Mental Health Program Evaluation. Washington, D.C: Superintendent 
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FIGURE 24 
Qlobal AasMsmsnt Seals (OAS) 

3/1/78 

Global Assessment Scale (GAS) 
Robert L Spitzer, M.D., Miriam Gibbon, M.S.W., Jean Endicott, Ph. D. 

Rate the subject's lowest level of functioning in the lest week by selecting the lowest range which deKrIbes 
his functioning on a hypothetical continuum of mental health-illness. For example, a Subject whose "be- 
havior is considerably influenced by delusions" (range 21-30), should be given a rating in that range even 
though he has "major impairment in several areas" (range 3V40). Use intermediary levels when appro- 
priate (e.g., 35, 58, 62). Rate actual functioning independjnt of whether or not subject is receiving and 
maybe helped by medication or some other form of treatment. 

Name of Patient - ID No. Group Code 



Admission Date Date of Rating Rater 

GAS Rating. 

100 Superior functioning in a wide range of pctivities, life's problems never seem to get out of 
I hand, is sought out by others because of his warmth and integrity. No Symptoms. 
91 



90 Good functioning in all areas, many interests, socially effective, yenerally satisfied with life. 

I There may or may not be transient symptoms and "everyday" vrorries that only occasionally 

61 get ou: of hand. 

90 No more than slight impairment in funutioning, varying degrees of "everyrfuy" worries and 

I problems that sometimes get out of hand. Minimal symptoms may or may not be present. 
71 



70 Some mild symptoms (e.g., depressive mood and mild insomnia) OR some difficulty in several 

j areas of functioning, but generally functioning pretty well, has some meaningful interpersonal 

61 relationships and most untrained people would not consider him "sick." 

60 Moderate symptoms OR generally functioning with some difficulty (e.g., few friends and flat 

I affect, depressed mood and pathological self*doubt, euphoric mc^ and pressure of speech. 

51 moderately severe antisocial behavior). 

50 Any serious symptomatology or impairment in functioning that most clinicians would thinly 

I obviously requires treatment or attention (e.g.. suicidal preoccupation or gesture, severe ob- 

I sessional rituals, frequent anxiety attacks, serious antisocial behavior, compulsive drinking. 

41 mild but definite manic syndrome). 

40 Major impairment in several areas, such as work, family relations, judgment, thinking or mood 

I (e.g., depressed woman avoids friends, neglects family, unable to do housework). OR some im- 

I pairment in reality testing or ccmmunication (e.g.. speech is at times obscurr illogical or 

31 irrelevant). OR single suicide attempt. 

30 Unable to function in almost all areas (e.g., stays in bed all day) OR behov-.v< considerably in- 

I fluenced by either delusions or hallucinations OR serious impairment in oommunication (e.g., 

21 «3metimes incoherent or unresponsive )or judgment (e.g , acts grossly inappropriately). 

20 Needs some supervision to prevent hurting self or others, or to maintain minimal personal 

I hygiene (e.g., repeated suicide attempts, frequently violent, manic excitement, smears feces), 

I I OR gross impairment in communication (e.g., largely incoherent or .nute). 

10 Needs constant supervision for several days to prevent hurting self or others (e.g., requires an 

I intensive care unit with special observation by staff), makes no attempt to maintain minimal 

1 personal hygiene, or serious suicide act with clear intent and expectation of death. 
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Source; Endicott. J.; Spitzer. R. I.: Fleiss, J. L.; and Cohen, J. The Global Assess- 
ment Scale: A procedure for measuring overall severity of psychiatric distur- 
bance. Archives of General Psychiatry, 33:766-711. 1976. Reprinted with permis^ 
sion of the copyright holder. Copyright 197276» American Medical Associa- 
tion. 
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A Saif-administered Symptom Checklist: The SCL>0O<R 
SCL-90-R 



Hum: 

Locttion:. 
Ag.: 



Ttehnieim: . 
ViiitNo.:_ 
Rtmirtti; 



_l(tant No.. 



Mod*; S-R 



INSTRUCTIONS 

Sclow it 1 lilt of problimft md eomplMits thit piopli lofmtimti h«v«. Read ttch on* ctrefbllv. md mkct on* of th« 
numteivd dtlertpton thit bttt dticrtbti HOW MUCH DISCOMFORT THAT PROBLEM HAS CAUSED YOU DURING 

THE PAST .INCLUDING TODAY. Piw thil number in the open block to ih* rl^t of the proWim. Oo 

not Alp my items, md Print your number dterty. I f you chm^ your mind, trtM your flnt number COfflPlittiy. Rtad the 
eNVTipli b«Iow befeie bieinnin^ and If you heve my queitions pliHt ak the nehnteim. 



Example 

how much were you distressed dy: 



Ex Body Achet 



Aftsw«r 



0 Net It tt\ 
1 A imw wt 
IMedirmhr 
3 0iMtt ikil 
e CkmimIv 



t 

2 
3 
4 
5 

i« 

7 
B 
. 9 
10 
t1 
\2 
13 
14 

»5 
16 
1? 
18 
19 
20 
21 

* 24 

■ 

1 26 

I,; 



Headache* 

Ncivouineu or thakmeii irwidv 

ftlp«ated unfAtntrw thoughts that won't lacve your mind 

FfintneM or di/ finest 

Lost of sexual mterett oi pleasure 

Feeling critical of others 

The idea that som«ooe eiso cap control yoor thoughts 
Feeling others aie to ^^^'oWnoti of your troubles . 

Trouble remembteTO^n^^ ^< 

Worrled^o^^^l|l^ess 
Foeiing«^^ Ihnoycd ^mO^ 
Pains in heart o^|^ 

Feeling I^P^in Bpen ipaces or on the streets 

Fueling low m energy 01 SIUM(«d down 

Thou^ts ot ending you' 

Hearing vo'CFS that uthvr people do not he a' 

Trembling 

Feeling thjt nioit people cannot b* tiutud 
Poor jppetito 
Cryinq e«iiv 

FeVlinq shy or unp**v ^'f^ thf opposite W« 
lieeiinipo' twni^ t'lpoed o" ciuq^t 
Suddenly scitrtt lot r^o 'tfiXon 
Tempor OuII)u'tt% th-it t OtiUt '^Ot Ctv^lrOI 
F«>i>i«nq dli^i) iii<{n(nit i»f v^^ui hou«» A\on€ 
liHsn.i\q y(i.,tu>l* fo< thinqt 



□ 

n 
□ 
□ 
n 
.□ 
□ 
□ 
□ 
n 
□ 
□ 
□ 
□ 
n 
n 
□ 
n 
□ 
□ 
[J 
□ 
n 
□ 
□ 
n 



HOW MUCH WERE YOU DISTRESSED BY: 



0 Net « IH 

1 A iittte wi 

1 QutM I Wl 
4 extremity 



28 Feeting blocked m getting things done 

i9 Feeling lorwly 

30 Feeling blue 

31 Worrying too much about things 

32 Fteling no interest m things 

33 Feeling l»ai\]| 

34 Your feeltngs being eaiily hurt 

35 Other peopii bttng ewart ^your prtvit* thoughts 

36 Feeling othen ^^i\l*^|pdyou or are 



37 Feeli.l^lhl^W aiv t&V^Mc^tli vou 

38 Heving%| do thgui WM^y to insure correctness 

39 HeArl paun(M|j\raCing 

40 NauteWtfOpset stomach 

41 Ferhng mfenor to others 

42 Soreness of your muicle^ 

43 Feeling that you art watched or talked about by others 

44 Trouble faihny asleep 

45 Having to check and doubiecheck what you do 

46 UiKiCuity mak.ng dccnior^s 

47 Feeling a'ra'O to itavel on buses, subwtvs. or tiams 

48 Trouble getting voul Ofeath 

49 Hot or cold spells 

&0 Havin<j to avoid certam thmgt. places, or activities t)bc*use 
they fii^ten you 

51 Your mind go^ng blank 

52 Nurrbncss or tinqhnq m parts ot your body 

>a6k owt --- - - . 

eLEASE CONTINUf ON THE FOLLOW.'NO fAOfc V 



□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



COFv RIGHT BV If ONARO ft OEftOQATiS P>* O 



□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 

n 
□ 
n 
n 



□ 
□ 
□ 
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A S«lff-«dnfilnltt«r«d Symptom Chsekllst: 
Thtt SCL-90-R (Cont'd.) 



SCL-90-R 



KOW MUCH WEM YOU DISTRESSED iV; o'n««^ 

1 A Itttit 
4 



63 A lump <n your throat 

54 Feeling hopeieit «bout tht Murt 

55 Tfoubli cor>c«niriiing 

56 Fttling Mik in MrtI of vour body . . 

57 Fveling XMAtt or ktyod up . 

56 H*«vv Mlingi m your irmi o^9» 
59 Thou^M of dtith ^^\^^ 



61 Fueling ui 
ebout you 
63 Hiving thi 
63 Hiving ur( 




talitind 



ibtit. injuiv. or harm tomaonv . ■ 
64 AwaktntnQ m th< fariy mOn...ig 
66 HaviPq to r«p«#t n<r tame ac»-ini luch ai touching, 
counting v»-a»hing 

66 Sii>«p th4f It rtltttu ordnti -bad . . . . 

67 Havin, urgtt break imwh thmgi 

Having idaas or behef* thit othtn do not ihara . 
tv Feehng o v Mif coowiCu* with ^ lh«rt 
70 F«*i»ng onaaty ifi "rowdj. vich m (hoppinQ or at a 



□ 
□ 

c 
□ 

□ 
c 

□ 
.J 
□ 
□ 

.□ 
.□ 
.□ 

.□ 



HOW MUCH MERE YOU DIIT^EUED iV 



0 Nat ami 

1 A iiMa fed 

a Mak^raMv 

iQutM tm 

4 Ixtiwuafy 



71. Ft«lmg avf.-lhinp i an i- 'bri 

/S.SpalUw/tarr" or panic 

73. PMlmg incomfortabl bout aatmg or dnnkinQ m public 

7' Oatting into fitQuant argumtntt 

76 FtaUn» narv^t* wrhan you in Itft alooa. . 

76 O \in not B'vnfl yf ■ propar en t for your wAiavtinanti 

77 PtaUnglonal- ivtn Mhan w^j ai«#ith paopla 

78. ftaling w raitlati you * * 

7it. i^taltn^ ''^ ^j^^TviKi^' ' ^ 

60. Tha fMiir^ t^ad^p^tHmg Ji^d^r^ to you 

d Shouung or mW^Hng VJj^ - 

82 Ftaling •f'*'djLM in public 

83 -Aling that pV^l^^ill tika advanta^ ot you if you 
lat tham 

84 Having thou/iti about Hx that botNr you • lot 

85. Tha idaa mat you ihould ba puniihad for your imi. 

66 Thou^ts and imagii of I fn^tanmgnaturt 

87 Tha idai thit lomathmg t«riou» n wrong with your body 

88. Na^ar faaltng cloit to anothar P*r«on 

89 Faahngi of 9Uilt 

00. Tha ida« that lorriathinfl <l wronfl wilh your mind 



□ 
□ 
□ 
□ 
□ 

□ 
□ 
□ 
n 
□ 
□ 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



Source: Derogatis, L. R. The SCL-90 Manual I: Scoring Administration and Pro- 
cedures fortheSCL-90-R. Baltimore: Clinical Psychometrics Research, 1977. The 
SCL-90-R IS reprinted with permission of the author and copyright holder, Leonard 
R. Derogatis, Ph.D., Director, Division of Medical Psychology, Johns Hopkins 
University School of Medicine. Requests for the Administration Manual, further 
informstion, or order forms for the instrument should be addressed to Dr. 
Derogatis, c/o Clinical Psychometric Research, 1228 Wine Spring Lane, Towson, 
Maryland 21204. 
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FIGURE 26 



A Social Adjustment S«lf-R«port 



The Social Adjustment Self-Report form was developed 
by Myrna Weissman, Ph.D. and her colleagues at the 
Depression Research Unit, Department of Psychiatry, Yale 
University School of Medicine under contract with the 
Alcohol, Drug Abuse and Mental Health Administration, 
U.S. Department of Health and Human Sen/lces. For further 
information, see Weissman, M.M., and Bothwell, S. The 
assignment of social adjustment by patient self-report. 
Archives of General Psychiatry. 33:111-115, 1976. 
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FIGURE 26 
Social Adjustment Self-Report 
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Date 



Rater's Initials: | | Computer Date 
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SOCIAL ADJUSTMENT SELF REPORT QUUSTIONNAIRE 

We aru mterosted m finding out how you hav- been domr, in the last fwo wevks. VVp would like you to 
ar.svver some question, about york work, sparo t.me and your t.-nlly l,!e. There are no r.qht or wrong 
answP.s to these questions. Check the ar.sw.rs t hat best d.scnU^s how ynu have been .n the last fvvo weeks 



WORK OUTSIDE THE HOME 

PlMJe check the suuauon that best describes you. 

I am U I a worker tor pay 4 I 1 retired " 

2 { I a housewife b i 1 uneniplnyeil 

3 1 1 a student 

Do you usually work for pay more than lb hours per week'' 

1 [ ! YES 2 1 ' NO 
Old you vvork any hours for pay in the last two weeks' 

1 : : YtS ? ■ ■ NO 

Chei k the answer W.U hnJ. liPscr'ht^ f'0\^f yo-t /mv»* twt"> 
in (ht^ /«nf tv\0 v^Pek V 

\. How many day^ did you miss ftom work in the last two weeks' 
\ U No days missed 
2U One day 

3D 1 missed about f>alf the time 



5. Have you felt upset, wornari, or uncomfortable while domo 
your work during the last 2 weeks? 

1 i i i never fell upset 

2 I. 1 Ot>ce 01 twice I felt upset 

3 . ; Half i»»e t'^'f" I f^'^ ^^^^^ 

4 1*1 fell irpspt nn)sl uf the tirne 
t, I : I fi'M "P^»'i J'l '''P 

6. Have vou found your work interesting these last two weeks' 



1 * Mv wiiik Wits dlnmsl .iU\dvs mlerestuni 
7 t)ni i> nr twn e my wnrk was not Miien'st>ny 
.'5 Half ^Hn tin:** «ny work WdS unmieresimq 
4. . M;)SI (if Ihn tune rny work WtlS unit^terpstmg 
I) ; Mv W"f »^ w.n always iinmteresimq 



♦ D Mmtd more than hill thttnflrtrtrnJttf'inikrjT — * 
iiatt oni diy. 

5 □ 1 did not work any days. 

8 □ On vacation all of ihe last two weeks 

// you have not mrked any days m the fast t\/vo vveek^, go on 
to Question ?. 

2. Have you baen ibit to do your work in the last 2 weeks? 

iG { did my work very welt. uK) 

2 CJ I dtd my work well but had some minor problems, 

3 □ I needpd help wtth work and tiid noi do well about 

half the time. 

4 □ I drd my work poorly most of the time. 

5 □ I did my work poorly all the time 

3. Have you been ishtmed of how you do your work in the 
{ast2weiks? 

1D I never felt ashamed (i<() 

2 □ Once or twice I felt a little ashamed. 

3 □ About half the time i felt ashamed. 

4 U I felt ashamed most of the time. 

5 ri I felt ashamed all the trme. 

4. Have you had any arguments with people at work tn the 
last 2 weeks? 

1 □ I had no arguments and got along very well. cjoi 
? n I usually qot along well but had minor arguments, 

3 G I hdd more than one argument. 

4 :.I I hdd many arguments. 

5 [ .! 1 was constantly in arguments 



^ORfCArffDMr ^fiUmiWvfS ANSWER QUBSriONS 
f12, OTHimSB. GO ON TO QUSSTION 13. 

7. How many days did you do soma housework during the 
last 2 weeks? 

1 L ] Every (lay. 

2 uJ I did tho housework almost every day 

3 [J I did the housework about half the time 

4 ! : I usually did not do the housework. 

5 L J I was completely undble to do housework 

8 . i I was away from home all of the last two weeks. 

8. During the last two weeks, have you kept up with your 
housework? This includes cooking, cleaning, laundry, 
grocery shopping, and errands. 

1 i ' I did niy Aurk very well i jj) 

2 f J I did n)y work well but had some minor problems. 

3 [ I I nepderi help with my work dnd Jid not do it well 

about half the time. 

4 L.J I did niy wurk poorly most of tl»e tnui? 
b [. 1 I did my work poorly all of the innt' 

9. Have you been ashamed of how you did your housework 
during the last 2 weeks'' 

1-1 t n«ver fell ashamed » jf>i 

2 i I Once or twirp I fnlt a little ashamed 

3 ! ! Ahddt half ilip tinip I felt dsii,inied 

4 ; j I felt ,isi»dined most iif the time 
b ' : I felt dshdiuf-il all the wnv 
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SOCIAL ADJUSTMENT SELP REPORT QUESTIONNAIRE (Page 2 of 6) 



10. Hivs you had iiny arguments with salespaoplt. tradesmdn 
or neighbors in the last 2 weeks? 

1 LJ 1 had no argumDnts dnd qol along vcrv well. c^b) 

2 □ I usuallv got along wall, but had minor ar^jumcnis. 
3D I hart more than one argument 

4G I had many arguments. 

S n 1 was constantly ir» argumenls. 

11. Have you felt upset while doing yonr hou\'>wQrk during the 
list 2 weeks? 

1 LJ 1 never felt upset. 

2 [*] Once or twite i felt upspt. 
3[ j Half Ihfi time I Idt uPset 

4 . ] I felt upset most of the time. 
S LJ 1 felt upset all of the tim^ 

12. Have you found your housework interesting these last 
2 weeks? 

1 □ My work was almONt always m^jrestinq a*^* 

2 [ ] Once or twice my work was not interesting 

3 LJ Half the time my work was unmterestmg. 

4 L3 Most of the time my work was uninteresting. 
!i □ My work was always uninteresting. 



14. Have you bMn able to keip up with your cUss work in the 
fast 2 weeks? 

1 LJ I dfd my work very well. <3i > 

2 I J I did my work well but had minor problems 

3 LJ I needed help w«th my work and did not do well 

;iboul half the lime 

4 ' .] I did mv work poorly most of the time 
b L i 1 Old my work poorly all the time. 

15. During the last 2 weeks, have you been ashamed of how 
you do your school work? ^^^^ 

1 i : i rtcvJir felt ashamed 

? ;■ Once oi twicc I fell ashamed 

3 ; ! Ahdtit holf thr time 1 felt ashamed. 

4 !. . 1 felt dshanietl "«o^t of the time 

Ti \ I felt ashanted all uf me time 

16. Have you had any arguments with pvople at school in the 
last 2 weeks? 

r. ; I hdd no arguments and qut aiOng very well (33) 
2i 1 I usually qni alofiq well biM fad minor arguments 
3 [ : 1 had more than one argumint. 
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FOR STUDENTS 

Answir Qu$stiofis 13- 18 if you go to school hall time or more. 
Otherwisf, go on to Question 19. 

Whit best describes your school program? (Chouse one) 

1 □ Full Time (2») 

2 □ 3/4 Time 

3 □ Half Time 

Check the answer that best describes how you have been the 
last 2 weeks. 

13. H ow miny diys of clisses did you mitt in the last 2 weeks? 

1 □ No days missed. (30) 

2 □ A few days missed. 

3 □ I missed about half the time. 

4 □ Missed more than half time but did make at least 

one day. 

5 □ I did not go to classes at all. 

8 Gl was on vacation all of the last two weeks. 
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4D I hed meny arguments. 

60 1 was constantly in arguments. 

8 □ Not applicable; I did noi attend school. 



17. Heve you felt upset et school during the lest 2 weeks? 

1 □ 1 never felt upset. (34) 
2n Once or twice I felt upset 

3G Half the time \ felt upset. 

4r] I felt upset most of the time. 

5D I fell upset of the time. 

Sn Not applicable. I did nut attend school. 

IB. Hive you found your school work interesting these lest 

2 weeks? 

lO My work was almost always interesting. (3&) 
20 Once or twice my vvork was not interesting. 
3G Half the tim<> my work was uninteresting. 
4rj Most of the time my work was unmteresimg. 
Sn My work was always unmteresting. 
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SOCIAL ADJUSTMENT SELF REPORT QUESTIONNAIRE (Page 3 of 6) 



SPARE TIME - EVERYONE ANSWER QUESTIONS 19 27. 

Cheuk the jnswer th^t best describes how you have been in 
the fdU 2 weeks. 

19, H ow many friends have you seen or spoken to on the 
telephone in the last 2 weeks? 

1 [ ; Nine or more fnends. 

2 [ J Five tn eight fnends. 
2\ ] Two to four fnends. 
4\ 1 One fnend 
S'l No Inends. 



20. Have you beer) able to talk about your feelings and problems 
with at least one fnend during the last 2 wepks? 

1 !.i I can always talk about my mnennost teelmqs 

21/: 1 usually cai^ talk ahoul n\y feelmgs 

3 ; 1 About half the time I felt jhle to talk dlioul my feelinQS 

4 [ . I usually was not able tn talk about nty leelmqs 

b [ J I was never able to talk about my feelings 

8U Not applicable. I have no fnendv. 



(41 ) 



24. If your feelings were hurt or offended by i friend during 
the last two weeks, how badly did you take it? 

1 f] It did not affect me or it did not happen. 
21.1 I got over it m a few hours. 
3[ 1 I gut over it in a few days. 
4Lj I got over it in a week, 
(j! 1 It w»ll take me months to recover. 
8: J Not applicalilH, I h«jv« ni, ^nends 

2&, Have you felt shy or uncomfortable with people in ihc 
last 2 weeks? 

r' i 1 always fell fP'r for table ^^^^ 
?, SnituMiines ' felt uiKumlortahle hut could relax 

jfter J while 
3. About half the limp 1 fell uncomf ortdble 
4i • I usually fpl^ imcomf ortdble. 
b* I always felt uncomfortable 
8 ^ Nut jpplirdble. I was never witb people. 



t ■ . 



21, How may timt t in thi last two wNks hava you gona out 
soeialty with othar paopla? For axampla. visitad friandt. 
gona to movias. bowling, church, rastaurants, invitad 
fritndstoyour homa? 

1 □ More than 3 times. (38) 
2U Three times. 
3rj Twice. 
4D Once. 
5 0 None. 

22r How much tima have you spent on hobbies or spare time 
interests during the last 2 weal(s? F or example, bowling, 
sewing, gardening, sports, rtadii^g? 

1 □ I spent most of my spare lime on hobbies almost (3ii) 
every day 

2G I spent some sparB lime on hobbies some of the days. 
3D ( spent a liitte spare time on hobbies. 

4 □ I usually did not spend any time on hobbies but did 

watch TV. 

5 U i did not spend any spare time on hobbies or 

watching TV. 

23. Have you had opan arguments with your friends in the 
lest 2 waei(s? 

1 □ (had no arguments and gui along very well. (40) 

2 U I usually got along well but had minor arguments. 
3D I had more than one argument. 

4 □ I had many arguments. 

bD I was constantly in arguments. 

8 □ Not applicable; I have no friends. 



26. Hava you fait lonaly and wishad for mora friands during 
tha last 2 wnks? 

iD I have not felt lonely. ^-t^) 

2 U I have felt lonely a few times. 

3 □ About half the time I felt lonely. 
4r.J I usually felt lonely. 

5 1 .] 1 always felt lonely and w>shed for more friends. 

27. Have you felt bored m your spare time during the last 
2 weeks? 

nil never felt bored t44) 
2 [ 1 I iisudlly did not feel hored 
3LJ About half the time I felt bored. 

4 [ j Wost of the lime I felt bored. 
6 [ J I was constantly bored. 

Are you a Single, Separated, or Divorced Person not living with a 
person of opposite sex; please answer below 

1 D YES. Answer questions 28 & 23. uS) 
2CJ NO. go to question 30 

28. How many times have you been with a date these last 

2 weeks? 

I D More than 3 times. 
21.1 Three times. 
3rj Twice. 
4L.1 Once, 
bll Never. 
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SOCIAL ADJUSTMENT SELF REPORT QUESTIONNAIRE {Pa9e4of6) 



29. HiV0 you bten inttrtsttd in diting during tlit list 2 
mtki, W f ou tiav« noi dated, would vou have liked to? 

1 [1 I was always interested m datiny. 

2 □ Most of the time 1 was interested. 

3U About halt of the tin^e I was interested. 
4 U Most of the time 1 was not interested. 
&L1 1 was completQly uninterested. 

FAMILY 

Answer Questions 303/ Jbottt yourpjrents. brothers, vsters. 
in lam, and children not Imng at borne. Have you been m 
contact With any of them ,n the last two weeks^ 

\ □ YES. Answer questions 30-37. 

20 HO, Go to question 36 

30. Have you had open arguments with your relatives in the 
last 2 weeks? 

\ {'] We always got along very well. 

2 LI We usually got along very well but had some mmor 

arguments. 

3 □ I had more than one argument with at least one 

relative. 
4U 1 had many arguments 
5D I was constantly in argu"^""^^- 



34. >1ave you wanted to do the opposite of what your relatives 
wanted in order lo make them angry during the last 2 
weeks? 

1 [ 1 I never wanted to oppose them (^2) 
2[ 1 Once nr twice I wanted to oppose them. 
3L.) About hall the time t wanted to oppose them. 
41 i Most of the time I wanted to oppose them, 
bill always opposed thorn. 

35. Have you been worried about things happenmg to your 
relatives vifithout good reason in the last 2 weeks? 

I [ 1 I have not worried without reason 
2 1 1 Once or twice I worried 
31 1 About half ihe time I worried 
41 i Musi of the time I wcfMed 
bl ) I have wuffied the entire time 
81 ! Not applicable, my relatives are no lonqei livmg. 



(53) 



31. Hm yty kmn iblt ti tiili iliut your ftttiiiii ani proMimi 
vvith at Itait mi VOuf rtUthMS tn thi list 2 wtikt? 

1 □ I cm ilwiyi talk ibout my fillings with at lust oni 

rilitivi. U9) 

2 □ 1 usuiliy cm talk about my fillings. 

3^ About hilf the time 1 felt able to talk about my 
fMlings. 

4 □ I uSuilly was not able to talk about my feelings. 
5D I was navar able to talk about my feelings. 



32. Hevt you evoicfed contaati with your reletivei theia last 
two WMkS? 

1 □ I have contacted relatives regulerly. (50) 

2 □ I hevi contacted a reletive at leest once. 

3 □ I hevi waited for my relatives to contact me. 

4 □ I avoided my reletives, but they contectad me. 
SD I have no contacts with any reletives. 

33. Did you depend on your reletivti for help, edvice. money 
or friandship during the leit 2 wHks? 

1 □ I never naed to depend on thim. 

2D I usuelty did not need to depend on them. 

3D About half the time I needed tn depend on them. 

4D Most of the time I depend on them. 

SD I depend completely on them. 
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€V£RY0NiinsmrQuistms36ind37, $¥in if your f$litim 
ifft notifying. 

36. During the last two wHks. havt you bHn thinking that 
you have let eny of youi reletives down or heva been 
unfeir to tham at any time? 

1 □ I did not feel that I let them down at all. (54) 

2 □ t usually did not fiel that 1 let them down. 

3 LJ About half the time I felt that 1 let them down. 
4U Most of the time I have felt that I let them down. 
5 □ i always felt that I let them down. 

37. During the lest two wHks, heve you been thinking thet 
eny of your reletives heve let you down or heve been 
unfeir to you eteny time? 

1 □ I never felt that they let me down. (55) 

2 □ 1 fell that they usuelly did not let me down. 

3 □ About half the i ' ■ I felt they le\ me down. 

4 n I usually have fi :hat they let me down. 

5 n I am very bitter that they let me down. 

Are you living kV/f/i your spousf or have bten hvmg With a 
person of the opposite sex in a permanent relationship ■' 

1 n YES. Please answer questions 38-46 (56) 

2D NO. Go 10 question 47 

38. Heve you hed open ergumenuwith your periner in the 
lest 2 weeks? 

1 □ had no arguments and we got along well. (57) 

2 Ci Vii usually got along well but had minor arguments. 

3 □ We had more than one argument. 
4G We had mpny arguments. 

5G We were constantly in arguments. 
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SOCIAL ADJUSTMENT SELF REPORT QUESTIONNAIRE (Pige 5 of G) 



39. Hivi you bam ibli to tilk ibout your fHlings ind 
problimt with your pirtnir during thi list 2 wtiks? 

1 □ i could always talk freely about my feelings. 
2D I usually could talk about my feelings. 
3 □ About half the time I felt able to talk about m> 
feelings. 

4D 1 usually was not able to talk about my feelings. 
5D I was never able to talk about my feelings. 

40. Have you bnn demanding to have your own way at home 
dicing the lest 2 wMks? 

1 □ t have not insisted on always having my own way. 

2 □ 1 usually have not tnsistad on having my own way. 
3D About half the time I insisted on having my own way. 
4D I usually insisted on having my own way. 

5 □ I always insisted on having my own way. 

41. Have you bian bosstii around by your partner thast last 
2 weeks? 



1 □ Almost never. 
2D Once in a while. 
3D About half the time. 
4D Most of the time. 
$□ Always. 



C6U) 



44. How many times have you and your pertner hed 
tntercourst? 



(63) 



1 D More than twice a week. 
2D Once or twice a weak. 
3D Once every two weeks. 

4 D Less thdn once every two *.veeks but at least o'.ico in 
the last month. 

5D Not at all in a month or longrr. 

45. Have you hed eny p/obhms during intercourse, such es 
pein these last two v»eaki? 

ID None. 

2 n Once or twice. 

3G About half thu time. 
4L] Mc$t of the time. 
Alv/ays. 

8 □ Nof! applicable, no intercourse in the last two weeks. 
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42. Hqw much hivi you filt riipmdint on your pirtnir thiM 
list2wHks? 

ID I WIS indepsndent. 

2D I was usually independent. 

3D Iwanomewhat dependent. 

4D J was usually dependent. 

5D I depended on my partner for everything. 

43. How havt you flit about your pirtnar during thi lau 

2 waaks? 

ID I always felt affection. 
2D I usually felt affection. 

3 D About half the time I fell dislike and half the time 

affection. 
4D I usually felt dislike. 
bD I always fett dishke. 



46. How havt you fait about intarcoursa during tha last 
2 waakt? 

ID I always enioyed it. 

2 □ I usually enjoyed it. 

3 D About half the time I did and half the time 1 did not 

enjoy it. 
4D I usually did not enjoy it. 
&D I never enjoyed it. 



QUESTIONS 47 54 On Nexi Page. 
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SOCIAL ADJUSTMENT SELF REPORT QUESTIONNAIRE (Paga 6 of 6) 



CHILDREN 

Hive you had unmarried childmn, stepchild r$n, nr foster 
chddren living at home during the fast two weeks? 

1 □ YES. Answer questions 47-30. 
2D NO. Goto questionSl. 



<66) 



47. Hivi you bNn intiristid in whit your childnn in doing - 
school, pliy or hobbiis during the li$t 2 wtaks? 

1 □ I was always interested and actively involved. <ii7) 

2 □ t usually was interested and involved. 

3D About half the time mteretled and half the timo 
not interested. 

4D I usuelly was disinterested. 

SD I wasi always disinterested. 

48. Hive you bNn ibli to tilk ind llstin to your children 
during thi list 2 wiikt? Includi only childnn ovir thi 
aga of 2. 

1 □ I always was able to communicate with them. (6Hi 

2 □ I usually was able to communicate with them. 

3 □ About half the time I could communicate. 

4 □ I usually was not able to communicite. 

5 □ i eomplataly unablt to communicaii. 

llCLNotaMMi€aMa;nochlldrtnovtrthaifaol2. - 



FAMILY UNIT 

Have you ever been married, ever lived with a person of the 
opposite sex. or ever had children? Please check 

1L1 YES. Please answer questions 51 53. Hi) 
2U NO. Go to question 54. 

61. Hivi you worried ibout your partnir or my of your 
childnn without iny riison during the list 2 wtiks, evin 
if you in not living togtthar now? 

1 □ I never worried. (72) 

2 □ Once or twice I worried. 

3 □ About half the time I worried. 
4r] Most of the time 1 worried. 

5 □ I always worried. 

8[.] Not applicable; partner and children not living. 

62. During the last 2 wtiks hivi you bHn thinking that you 
hive let down your pirtnir or my of your childnn it 
iny timi? 



1 □ I did not feel I let them down at all. 

2 U I usually did not feel that I let them down. 
3G About hitf the time I filt I let thim down. 

4 □ Molt of the timi I hava fitt that 1 lit thim down. 
- 4 »f< i km down co m p lw aly. 



(73) 



49. How hivt you bNn ottting ilong with thi chilririn during 
• thilitt2 wttks? 

1 □ I had no arguments and got along very well my 
2D I usually got along well but had mntor arguments. 
3D I had more than one argument. 

4U t had many arguments. 

5U I was constantly in arguments. 

60. How Irava you fait toward your childran these last 

2 waeki? 

1 □ 1 always felt affection. i?t>i 

2 □ I mostly felt affection. 

3D About half the time 1 felt affection. 
4D Most of the time I did no* feel affection. 
5 D I never felt affection toward them. 



63. During the last 2 waaks. have you bnri thinking that your 
partner or any of your chlldrtn have lat you down at any 
time? 

1 U 1 never felt that they let m down. <74> 

2 □ 1 felt they usually did not let me down. 
3(J About half the time I felt they let me down. 
4LJ I usually felt they let me down. 

5D 1 feel bitter that they have let mc down. 

FINANCIAL - EVERYONE PLBASB ANSWER QUESTION 54. 

64. Have you had enough money to take care of your own 
and your family's financial needs during the last 2 week(? 

1 □ I had enougnt money for needs. 

2G I usually had enough money with minor problems 

3 □ About half the time 1 did not have enough money 

but did not have to borrow money 
4rj I usually did not have enough money and had to 

borrow from others. 
SU 1 had great financial difficulty. 
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FIGURE 27 

The Client Episode Outcome Summary 

CLIENT EPISODE OUTCOME SUMMARY 
Side 1 — DEMOGRAPHIC DATA 



CLIENT'S NAME (Optional) 

(PRINT) 



01 



Lilt 

CLIENT'S INITIALS 

Last, First, Middle 



BIRTHDATE AND AGE 
M M D D f Y AGE 



02 



SEX 



03 



Female 



04 



RACE 

1=VVhita. 2sNagro or Blick. 

■xican>Arn«ricin. 4=American 
OriemftL 6=0ther Nonwhha 



□ 1=VVhitt. 
Indian. 5=i 



05 



I I 5= 



MARITAL STATUS 

I^Navar Marriad. 2=Now Marriad. 
=Wldowad. 4=0isiolvad. 
Saparatad. fisCommon law. 
7= Unknown 



06 



EDUCATION 
Number ui Years 



07 



OCCUPATION 

Entar Code From 
Occupation Key 



EMPLOYMENT STATUS 



08 



3=U, 
6s: Ui 



= Full lime. 2=Part tima. 

nampJoyad. 4=Sa4f-amployad. 

Unknown 



First 



09 



Middle 

GROSS INCOME 

Use IrKome from 
UMDAP 



CENSUS TRACT and/or HEALTH DIST. 
(Optional) 



10 



and/or 



STATE USE ONLY 



11 



COUNTY USE ONLY 



12 



CASE NUMBER 



13 



CR/DC PROVIDER DUMBER 



14 



REPORTING UNIT 



15 



^:NTRY DATE 
M M O D Y Y 



16 



This 2-part form, a revlaion of a aimilar form used by the St tte of California Dapartment of 
Health, i« reprinted from Resource Materials for Community Mental Heatth Program 
O Evslustton (Second Edition) edited by WilHem A Hargreai^es. C. Clifford Attkisson, and 

^[^(]] James E. Sorenaea DHHS Publjca|lon^No. (ADM) 79-238* 1979. 
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(CONTD) 



CLOSING DATE 
M M D D Y Y 



17 



18 



REFERRED FROM 

Use Codes from 
Referral Code List 



19 



REFERRED TO 

Use Codes from 
Referral Code List 



IF INVOLUNTARY ADMISSION W h \ 5160 
20 



□ 



2=0ano«r to Self 
3=0af>g«r to Oth«r« 



ALL LEGAL CLASSES DURING 
EPISODE 
Add Applicable Binary 
Codes and Enter Sum 



01=Voluntary 
02=72hr. Detention 
04=1 St 14 Day Certification 
08=Additional 14 Day 

Certification 
16=90 Day Post Certification 
32=Con8ervatorahip — Temporary 

or Permanent 



22- COSTS AND UNITS OF SERVICE 



MODE OF 
SERVICE 


COST 
CENTER 


□ 


LU 


n 


111 


□ 


III 


□ 


1 1 1 


□ 


II 



RATE 
(Round to Nearest $) 



NUMBER OF 
UNITS 



MODE OF SERVICE CODES 



Inpatient.. 



Partial Care ^. 2 



Outpatient 

Assessment 3 

Chemotherapy 4 

Collateral 5 

Individual 6 

Group 7 



^ER 1434.A (6/74) 



ERLC 
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FtQURE 27: Th« Client Epiiodt Outcom* Summary (CONTD) 



CLIENT EPISODE OUTCOME SUMMARY 
Side 2* SERVICES ASSESSMENT SUMMARY 



XONFIDENTIAL PATIENT/CLIENT INFORMATION 
Sea California Welfare and 
Institutions Code Section 5328" 



INSTRUCTIONS 

At initial Confct; 

COL A- Ch«ck •<! probl«mt dttcribing prtttnt impaimMnt. 

COL B> Ch«cfc all proMtms ¥^ch yoii intand to ch«no«. Circit th« checkmark for th« linglo problom 

vvNch wHI bo tho primary focus of your tffort i.o., primary problam. 
COL 0- For aach problam chookad in Col. A, antor appropriata numbar from Probiam Rating Scala. 

At Pinal Comact: 

COL D- For aach column chackad in Col. K antar appropriata numbar from Problam Rating Scala. 



PROBLEM RATING SCALE DEFINITIONS 

Tba following daflnitioni ara to b« uiad at initial and final contact in tho rating of aach problam 
chackad In COL. A. 

1 No Impalnnant. 

2 Minimal Impairmam* aymptoma praiant but iio dificulty raportad or obianrad in maimaining 

usual parfomianca lavala. 

3 Mild impainnant- raportad or obsafvad difficulty in maintaining usual parformanca lavals. 

4 Modarata Impairmam- raportad or obsarvad dacraaao in usual parformanca lavals. 

5 Savara Impairmam* raportad or obsarvad failura in usual parformanca lavals. 



GLOBAL IMPAIRMENT INSTRUCTIONS 

A. At initial contact datarminc tha ovarall rating of total impairmant in daily functions and rola 
raquiramants. Rtcord tha laval numbar in tat>la balow (No. 1). 

B. At final contact rarata global Impairmant and racord impainnant laval number in tabia below 
(No. 2). Check a or b as appropriata. 



GLOBAL IMPAIRMENT SCALE DEFINITIONS 
Ovarall rating of total impairmant in daily functioning arxi rola requirements... 

1 No symptoms obseivat>le or reported. 

2 Symptoms are very mild and observeble or reported but no impairmam in carrying out daily 
activities or in nMeting role requirement*. 

3 Symptoms ara mild and increased effort is required to mainuin unimpaired ;evel of functioning in 
daily actlvitiet end role requiremema. 

e 

4 Symptoms are moderate and there is an observable loss of efficiency/effectiveness in meeting 
daily activity and role requirements (e.g. done poorly or incompletely). 

5 Symptoms ara moderately severe arxJ clientfails to meet one or two important roles such as work, 
school, housework* spouse, parent or in community, e.g.. some activities not done at all. 

6 Symptoms are sevare and client fails to meet most role and performance requiraments. 

7 Symptoms are vary severe snd client fails to meet most or all role and performarK:e requirements. 



ERIC 
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INITIAL CONTACT 


Pinal 
Contact 




COLA 


COLB 


COLC 


COLD 


COMMON PROBLEM DEFINITIONS 


Ail 
Impair- 
mant 
Probi. 


Alt 
Probs. 
ToBa 
Sarvtd 


Ind. 
Prob. 
Rating 


Ind. 
Prob* 
Rating 


1. DEPRESSION- Rtports H tubj^ctiv* fMllngt md conc«ms arMl 
ptyohoioclal dytfiinotioiii irat nwy 09 tiiocittMi .m xnm om* 
pmisiv* tyndronw. 


01 




01 




01 






2. ANXIETY- RtportB of HibiMtiv* Mingt conc«ms. and ptycho- 
physiological dytfunctlonfi that may ba attoclttad with tha 
anxious* phobic, or obaaiilva-compulaivt tyndromai. 


02 




02 




02 


02 




3. INAPPROPRIATE AFFECT. APPEARANCE, OR BEHAVIOR- 
Appairanct. physical bahavior or aott w^lch wouM ba contldarad 
odd or Inappropriata by most untrainad paraoni. 


03 




03 




03 


03 




4. NEQATIVE-OBSTINANCY- RafuttI to tniMar quaationi or co- 
oparata; withholding Information. 


04 




04 




04 


04 




5. M ITATION* EXCITEM ENT- Ovart ligni of agitation or txcKamant 
{t.g. inability to tit itlll. pacino. handv^inglng. accalaratad spaaoh* 
hyparactivity). 


06 




06 




06 


06 




6. MOTOR RETARDATION-LACK OP EMOTION- Vliibit aigni of 
rvtarditfon In ipsach and nMvamtnt a tsndancy to Ignors tht 
lurroundingi. and flittanlng of affact or ganaral lacic of amotional 
■Mprtiiion. 


06 




06 




06 


06 




7. SPEECH DISORDERS- Imptirmant In tha fonn or organiiation of 
■paach (t.g. bloclti. ramblti. ia incoharant ituntri. ''Babytallta"). 


07 




07 




07 


07 




8 SUSPICION-PERSECUTION-HALLUCINATIONS- Diitruttful- 
nMi: ftalingi of hiving baan mittraatad. takan advantaga of. 
tricicad or puihad around: id«ai of rafaranca: various paranoid 
dalusiont: auditory hallucinatiofwvhich mocli«thraataa or command. 


06 




06 




06 


06 




9. GRANDIOSITY- Inflatadippraiiilof hit worth, contacts, powar. or 
itnowladga; boastings; tansational plans; dalutlons of powar. 
status, tcnowladga. or contact and hallucinations with a grandiosa 
connotation. 


06 




06 




06 


06 


r 


10. SUICIDE-SELF-MUTILATION- Suicidal thoughts, praoccupatioa 
thraats. gasturas or attsmpta. and thoughts or aoU of sal^ 

mutilation. 


10 




10 




10 


10 


11. SOMATIC CONCERN-PHYSICAL PROBLEM- Raal or imaginad 
physical complsint or ditability: convarsion rssction: somatic 
daiusion or hallucinations, hypochwKJriasIs; or body imaga coocam. 


11 




11 




11 


11 
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FIGURE 2'i : Th* Client Epltodft Outcome Summary (CONTD) 



12. DAILY ROUTINE*tEISURE TIME IMPAIRMENT- Tb« in^Mt of 
ntvchooitholcMiv on rtaitv routino. on cMTvkia throuoh ■•H^ftOoojnfH 
or •xpMtwl t«tKt. and on ututl Ititura timo or rocr«otion«l 
•ctivitios (o.Q. difficulty In •rising in ttit morning, getting drattod. 
and traveling). 


12 
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13. REPOflTED OVERT ANQER- Roportod or obtorvMl ov«rt tn^^r or 
MHg«r«no«; shouting, t«mp«r tantrums. 


13 




13 




13 




id 


14. DISORIENTATION-MEMORY IMPAIRMENT- Vitiblatignt of dir 
oriantationattotima, placa. andpArtoni. andimpainnantof raoant 
or ramota mamory. 


14 




14 




14 






15. SOCIAL ISOLATION* Lack of frtandt. avoidanca of contact or 
involvamant with othara. and faalinga of iaolatioa rajaction. or 
discomfort wHh paopla. 
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1 6. MATU RATIONAL PROBLEMS* Failura to achiava aga approprlata 
intarpanonal or family ralationahipa; and/or aga approprlata ad* 
aptiva bahavior (a.g.. work, achoot). 


16 




16 




16 




16 




17. DENIAL OP ILLNESS- Tba axtant to which tha patlant daniai. 
daapita tha ividanca. that hit currant lymptomi hava psychiatric 
signWcanca. that ha Is ill or naads psychiatric halp. or that ha naads 
to changa hit attituda in soma spacific way. 
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18. ANTISOCIAL OR ILLEGAL ACTS- Lying; ttaaiing; swindling: conn- 
ing: conrunission of or involvamant In minor or sarious illagal or 
daiinquant acts. 


18 
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18 
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19. ALCOHOL ABUSE- Tha dagraa to which tha usa of alcohol is 
axcassiva. compulsiva. causas physical symptoms oraltaration in 
mood or bahavior. or intarfaraa with parformanca of axpactad daily 
routlna or dutias. 
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20. ORUG ABUSE- Excassiva salfmadtcation and habituation or 
addiction to narcotics. barlMtuatas. stimulants, or consciousnass* 
attaring subttancas. 
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21. OANQER TO OTHERS* Has mada sarious throats of violanca or 
actual assaults against othar parsons (violanca against proparty not 
inciudad): child abusa. 


21 
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21 




21 




22. IMPULSE CON YROL* Ucks salf-discipilna; rasponsas to stimuli 
axcaed limits of axpectad bahavior. rasponsas to stimuli ara without 
ragard to consaciuancas; or Impulsas to commit dallnquant or illagal 
acts. 
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23. SEXUAL PROBLEMS- Sax rola confusion; angagas in saxual 
bahavior which iadafinad as unai;captablabysalf. family, orsoclaty. 
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FIGURE 27: Th« Cllwit Epiiod* Outcom* Summary 



(CONrO) 



24. PROLONGED EXPOSURE TO POOR ENVIRONMENTAL CON- 
DITIONS- Such •! long-term ditturbtd ftmity ralatlonth<'^. chron* 
to dytfunetioning or ibianca of ■ tionlfleant othor; ptyohotc M 
deprivation. 



26. SITUATION CRISIS* A decroete In ebllitv to copo with aotual or 
thrMttntd lost rolettd to teH-imtfle, role mettory or relitionthip 
with a BlgnHicant othor. 



26. HOUSEKEEPER ROLE- Admission of doing ■ poor job as ■ tK>uaa' 
kaopor. no plaasura or satisfaction in any aspaot of houiahold 
dutiaa: markad discomfort or difficulty witK or rafuul to carry out 
ona or mora axpactad housahold taska. 



27. WAGE EARNER ROLE- No intarast or satisfaction in ona's lob; 
draad of ona's work; fallura to maat task standards; naad for 
constant suparvlsion; ptyehopathology intarfaras wKh work; ax- 
oassiva job ohangas; or limiting onasalf to part-tima. temporary, or 
transient work baceusa of psychopathology. 



28. STUDENT OR TRAINEE ROLE- Poor moth/etion: evoidance of 
aveileble extrecurrtculer activfties; missing classes; difficulty doing 
homawork or essignmants; poor grades; need for axtansiva help; or 
conflict with teecheri or edministretton. 
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29. MATE ROLE-MARITAL PROBLEMS- Affactioneta faelings reraly 
exparienoad or expressed; meny querrels; itttle or no sexuel ectivfty; 
few sherad friends or eociel activfties. 



29 



29 



29 



26 



30. PARENT ROLE- Inability to carry out imporient child cere tesks: 
requiring considtrabia help to managa child; morbid fears of child 
being injured or III. 



30 



30 



30 



30 



GLOBAL IMPAIRMENT 
1. INITIAL RATING a. Service Completed Q 

b. Apparent Dropout Q 



2. FINAL CONTACT 



□ 



INTENT OF SERVICE 



□ 



Treatment 



[ I Maintenance Q Evaluation Only 



FINAL PRIMARY DIAGNOSIS 
DSM-2 for M.I., AAMD for M R. 



□ 
□ 



Mentally 
Disordered 

Life Crisis 



TARGET GROUP 

[ I Drug Abuse [ | 

□ Mentally I | 

Retarded I — I 



Alcoholism 

Children £r 
Adolescents 



SER 1434-8 (6/74) Probtom definitions adopltd In pant from Sp*tt#f. P L Endicott J ,wH ■!. Th« PiycWatric Statui 
Sch«duU (1970). Arch 0«n. P»vohl»t. 23.41 'W- 
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CHAPTER SIX 

IMPLEMENTING A 
QUALITY ASSURANCE 
SYSTEM 



Chaptor Six dMorIb** and d*ffin«« th« 
qvlillty ••suranc* oycia that ramadlaa 
daflolanolaa In oara idantlflad through 
tha mathoda daaorlbad In qhaptara Ona, 
Four, and IFIva. Approprlata aduoiitional 
an4 organisational lntanran|lona ara ax- 
amlna^ and oorrdbtlva plans for- 
miil«t*d. Kiraluatlon la atrasaad to 
f aa««4i ttHk adaquaoy off tha corractlva 
pr<^r«ni, and <lata davalopmant and in- 
dapth polley analyals ara daacrlbad as 
ala|»a In aatabllahing organizational 
olianga. 



KEY TOPICS 



• The function of the quality assurance system 

• The process of qualltjf assurance (steps Involved) 

• Identifying deficiencies In Individual, staff, unit, 
or program 

• Organizing programs for staff education and 
career development 

• Using data to change policy, structure, and 
procedure 

• Establishing organizational priorities— fiscal 
Incentives or legal Imperatives 

• Clarifying and modifying policy 

• Examining and using service data In the context 
of organization policy 

• The process of organizational change 
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CHAPTER SIX 

iMPLEMENTING A 
QUALITY ASSURANCE 
SYSTEM 

To the extent that peer and utiliaation review serve as catalyst^i 
for helping cHnidans and organizations improve their services^ they 
rt\Dx*esent central elements of a quality assurance system. The most 
important function of such a system is to discover problems and 
deficiencies in the delivery of care and stimulate eflorts to correct 
them. This chapter disci^sses general issues related to the quality 
assurance systom and provides <>xampleH of both educational and 
organizational interventions that can be used to correct identified 
problems and deficiencies in the delivery oi care. 

THE QUAUTY ASSURANCE CYCLE 

The process of discovering problems and deficiencies in the 
delivery oi* care and taking steps to correct them can best be 
schematized as a series of interrelated activities which comprise a 
quality assurance cycle. As shown in figure 28, the cycle begins with 
the identification of a problem f;nd moves to tht: stage ox problem 
analysis. Batied on the a\iaiysis, a set of corrective activities is 
undertaken. The impact of these activities is then measured in the 
same manner us^ed during the problem identification phase. 

In the preceding chapters* the basic modalities tor problem iden- 
tification have been detailed* specifically concurrent rt?vicw» profile 
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analysis, and clinical care evaluation studies. The current discussion 
focuses on other elements of the quality assurance cycle— problem 
analysis, corrective action, and evaluation. 

Analysis of problsms and daf Icianclas 
In \hm dallvary of oaro 

Once identified, problems must be conceptualized in a manner 
that facilitates action. The conceptualization should take into ac- 
count two factors: The magnitude and the locus of the problem. 
Specifying the magnitude— institution wide, a particular unit, an 
identifiable staff group or discipline, or an individual practi- 
tioner—enables those responsible for quality assurance to project 
the extent of intervention required. Identifying the locus of a prob- 
lem or deHciency, on the other hand, allows the quality assurance 
staff to formulate the required intervention based on whether the 
problem lies with a person or a program. 

Deficiencies in personnel arise from three major sources: insuffi- 
cient knowledge on the part of an individual, a lack of skills 
necessary for performing the required tasks, or staff attitudes in 
relation to the task at hand. For example, the inability of a staff 
member to meet the needs of persons with chronic mental disabil- 
ities for housing, food, and employment may reflect inadequate 
knowledge of the basic community support system— a deficiency of 
knowledge. A high dropout rate from group therapy may result 
from the use of group leaders with little or no training in the tech- 
nique of group therapy —a deficiency of skill. A therapist's case load 
may be significantly less than that of his peers because he will only 
work with patients that are suitable candidates for a specific 
therapeutic modality (e.g., behavior therapy, long-term psycho- 
therapy)— a deficiency of attitude. Each of these problems requires 
a different form of educational intervention. 

Organizational issues may also be at the root of problems in the 
provision of care. Institutions may have deficiencies in program 
structure, program poUcy, or procedures. For example, an unusually 
high dropout rate of Hispanic patients as compared to other ethnic 
groups despite an adequate number of bilingual and bicultural staff 
might reflect the lack of an organizational focal point with clearly 
delegated responsibility for providing service to this population— a 
deficiency of structure. The method of assigning patients to clini- 
cians in an outprtient clinic may delay placement sufficiently to 
cause large numbers of patients seen for evaluation to miss their ini- 
tial treatment appointments— a deficiency of procedure. Finally, 
the mean stay of inpatients with a diagnosis of depression in one 



ERIC 




102 Quality Assurance In Mental Health 

ward may be 2 weeks longer than patients on another ward because 
somatic therapies are not initiated until a 14-day trial of verbal and 
milieu therapy is completed— a deficiency of policy. Once again, 
each of these problems requires a different form of intervention, but 
these interventions are administrative rather than educational. 

It should be kept in mind that deficiencies of program may appear 
as deficiencies of personnel. Before deciding that a particular prob- 
lem reflects a deficit in knowledge, skills, or attitude on the part of a 
clinician or group of clinicians, the evaluator should be certain that 
clinician performance does not reflect a latent organizational prob- 
lem. For example, a clinical care evaluation study of inpatient care 
may reveal a marked delay in obtaining consultations when poten- 
tial physical problems are identified* A case analysis shows that 
some clinicians promptly submit consultation requests, others sub- 
mit these requests less promptly. If the analysis stopped here, one 
might conclude that the problem is one of person. But suppose that 
further analysis revealed a 8- to 4-day delay in answering consulta- 
tions regardless of when they were submitted and a cumulative 
debt of $3,000 owed the consultant for prior services rendered. 
What appears to be a problem of person then emerges as one of 
organization or program. 

Delineating actions for 
correcting the problem 

Through analysis of a problem in terms of its magnitude and 
locus, the intervention required and the people who must be involved 
in a corrective plan can be determined. When the problem reflects a 
deficiency of knowledge or skills, the appropriate interventions are 
likely to be educational. When the deficiency is one of attitude or 
program, the appropriate intervention is likely to be either ad- 
ministrative or organizational. While issues of attitude may be 
handled through supervisory channels, those of program require 
changes in structure, policy, or procedure. One must identify 
whether the primary mode of intervention will be educational ad- 
minis trative, or organizational In the process, it is important to 
define the desired behavioral changeSi educational goals, or system 
modifications required to deal with the problem. To the extent that 
goals are stated in measurable terms, the success or failure of the 
corrective plan can be determined objectively. This is not always 
possible; however, the corrective plan should specify the manner in 
which the impact of the intervention will be evaluated. A more 
detailed description of potential educational and organizational in- 
terventions is provided later in this chapter. 
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Evaluating tha Impact of aetlona takan 

The final step in the quality assurance cycle involves evaluating 
the effects of the corrective plan that has been initiated. At a 
minimum, the process will include a replication of the steps taken to 
originally identify the problem and a reanalysis of the data to deter- 
mine the extent to which the objectives have been achieved. Usu- 
ally, considerable reliance will be placed on the methods used dur- 
ing the problem identification phase of the cycle to generate these 
data, including concurrent review, profile analysis, and clinical care 
evaluation studies. Until the assessment of impact has been made, 
this process is a quality assessment cycle, not a quality assurance 
cycle. The assurance is achieved through closing the feedback loop 
by assessing the adequacy of the corrective program. 



In thinking about the educational needs of staff working within a 
mental health organization, it is useful to distinguish between ef- 
forts directed at: 

1. Insuring adequate baseline knowledge and skills 
for staff to perform the service tasks for which 
they have been hired 

2. Advancing individuals to higher levels of 
knowledge and expertise 

3. Correcting performance deficits detected as a 
result of supervisory, peer review, or program 
evaluation activities. 

These different objectives provide a format for organizing a staff 
education program. The elements of such a program would include: 
educational assessment during entry-level training, continued 
education and career development, and performance evaluation and 
supplemental instruction. 

Educational aaaaaamant and antry-laval training 

In the recruitment of staff to work in a mental health setting, at- 
tention is generally paid to a host of factors that, it is hoped, will 
predict an applicant's ability to make a substantive contribution to 
the program's service mission. The factors include not only educa- 
tional background and prior training in the mental health field, but 
other issues such as psychological sensitivity, ethnic background, 
knowledge of the community being served, and limitations imposed 
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by budget on potential salary levels. Indeed, for certain lower*level 
positions, only minimal knowledge of the mental health field may be 
required, other factors weighing more heavily in the decision to 
hire. Once an applicant has been hired, however, the organization 
has a clear responsibility to assess training needs and to ensure that 
new employees are able to gain the requisite skills and knowledge 
necessary to effectively perform the tasks for which they were 
hired. It is one thing to consider multiple criteria in the selection of 
employees and quite another to assure that employees can function 
effectively on the job. 

To meet this organizational responsibility, an educational assess* 
ment should be an integral part of the recruitment process. Such an 
assessment would take into account the range of backgrounds of 
employees and identify areas of educational need« The term ''educa- 
tional need'' refers to a new employee's need for both knowledge 
and. skills. Many needs can be met through supervised on-the-job 
training. In some instances, more formal didactic methods^ill be re- 
quired (c.gM seminars on the nature of mental health and illness, 
teaching exercises geared to developing skills as an evaluator, or 
tutorials in selected areas of patient management). An institution 
may undertake these educational tasks independently, or, if this is 
not possible, educational opportunities could be made available to 
staff through a combination of release time and/or arrangements 
with educational facilities within the community* 

When a program of entry-level training exists, it is important to 
realize that the staff involved are employees, not full-time students. 
An educational program which compromises the ability of service 
units to function at a reasonable capacity is unlikely to generate 
support from persons with programmatic responsibilities. For that 
reason, departmental heads, unit chiefs, and the like should be in- 
volved in developing the educational assessment and entry-level 
training program. 

Continued •ducatlon and caraor devalopmant 

It is important to distinguish between educational programs in- 
tended to advance staff members to higher levels of knowledge and 
expertise in their specialized fields and training programs to help 
personnel perform their service tasks better. The latter training, 
which may be highly specific and task-oriented, is most appropri- 
ately regarded as inservice training. The responsibility for develop- 
ing and implementing inservice training should be assigned to par- 
ticular service units. For example, instruction concerning the 
psychological management of acutely suicidal patients can best be 
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taught on an inpatient or emergency service, whereas a course on 
defense mechanisms could be offered on an ambulatory service or 
clinical unit. Since needs of service units often overlap, provision 
should also be made for cross-listing various inservice exercises to 
ensure access for appropriate nonunit staff members as required. 

Programs which allow individuals to build on and expand their 
skills so that they may advance to a higher level of knowledge and 
expertise relate primarily to career development and ideally should 
provide some tangible acknowledgement of professional growth 
such as a certificate or degree. They are often sponsored by profes- 
sional organizations or educational institutions, so many of these ac- 
tivities are extramural and staff participation occurs on a personal 
time. Whenever possible, however, service institutions should offer 
credit for its seminars and other educational activities. Because this 
requires some coordination between the service program and the 
educational institution or professional association, a locus of respon- 
..sibility for inservice and continuing education activities should be 
designated within the organization (e.g^ a training unit in a CMHC 
or a nursing department in a hospital). 

P«rformanc« •valuation and 
aupplamantal Inatructlon 

Evaluation of individual staff member performance is generally a 
shared responsibility. Program managers, service chiefs, discipline 
heads, and the peer and utilization review personnel all play a role 
in the evaluative process. Through service ratings, case review, and 
special studies, it is possible to identify problems in the delivery of 
services that require supplemental staff education. 

Supplemental educational programs may be either tutorial/super- 
visory or instructional. In mental health settings increased supervi- 
sion is commonly used to correct skill deficits, and tutorial/precep- 
torships to correct knowledge deficits. Instructional programs 
range from unsupervised self-instruction through the use of pro- 
grammed texts to enrollment in conventional didactic courses and 
seminars developed to address known skill or knowledge deficits. 
When practical, programs of supplemental instruction should be 
conducted at the institution or in the community where the clinician 
works. 

Participation in the quality assurance program can itself be of 
great educational value. Clinical care evaluation studies and profile 
analyses frequently identify unsuspected problems. When these 
studies are conducted at a local level, peer pressure can exert a 
strong force for behavioral change. Increasing awareness of prob- 
lems in clinical care is often a vital first step towards problem solv- 
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ing. The systematic examination of patterns of practice and the 
review of current clinical opinions in order to develop criteria and 
standards are also of educational value. This activity has the added 
advantage of making practitioners aware of the dichotomy between 
what they do and what they agree they should be doing. Participa- 
tion in the development of objective measures assaying the quality 
of care can lead to self-evaluation of individual patterns of practice. 
This in turn can produce important changes in attitude and behavior 
that profoundly influence the quality of clinical care. 

Implicit in the educational interventions discussed is the assump- 
tion that shortcomings in the delivery of care are due, in part» to in- 
adequate knowledge and skills. A corollary of this assumption is 
that better information will change clinician behavior and thereby 
improve the process and outcome of care. Neither the assumption 
nor its corollary has been proven. That clinicians lack all sorts of in- 
formation can be easily shown. What clinicians do with specific 
kinds of information, however, is poorly understood. What role in- 
formation and education have in altering behavior, how behavioral 
changes come about, and what significance these have for patient 
management are questions which remain unanswered. Nor do we 
know if there are critical times in a clinician's development when in- 
formation input may be ineffectual in modifying behavior. Thus, it 
is extremely important to continually evaluate the impact of educa- 
tional interventions and not to assume that they are effective. 
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ORGANIZATIONAL INTERVENTIONS: USINQ 
DATA TO CHANQE POLICY, STRUCTURE, AND 
PROCEDURE 

When considering organizational changes to enhance the quality 
of care, practitioners must keep in mind the overall functioning of 
the facility. Every organization must depend on its administrators 
to direct its activities, maintain and modify organizational struc- 
ture, allocate resources in response to needs and the changing rela- 
tionship to the environment, and anticipate and plan for the future. 
Administrators of mental health programs must balance requests 
for change with the need to preserve a degree of stability through 
the judicious manipulation of program policy, procedure, and struc- 
ture. To accomplish this, they need data such as: Who is being 
served? How served? By whom? How efficiently? With what result 
and at what cost? These data are used not only to monitor the v^ork 
of the organization, but also as feedback to change expectations, 
enhance organizational performance, and move the organization 
toward new tasks as they arise. Staff often lose sight of the impor- 
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tance of data in attaining their articulated goals. Too frequently 
they see only the monitoring aspects and view the evaluative needs 
of administration as a variation of the "big brother4s watching you** 
theme. Administrators need to educate staff to the value of program 
self-examination as a vehicle for measuring excellence and assuring 
continuity and growth. 

Generating data is relatively easy. Using it effectively, however, 
depends on the ability to ask meaningful questions. An ad- 
ministrator is well advised to begin by identifying the 
organization*s responsibilities and priorities. Given the usual 
limited funding, multiple goals of equal weight lead to ad* 
ministrative nightmares. Assigning equal importance to all tasks 
fosters generalized mediocrity and low organizational morale. On 
the other hand, emphasizing one task at the expense of others can 
throw an organization into imbalance, where good performance in 
one area leads to poor performance in others. Only a clear sense of 
an organization's responsibilities and priorities can guide an ad- 
ministrator through this particular Scylla and Charybdis. 

Some of the questions that must be asked are dictated by the 
source of program funding. Federally funded community mental 
health centers, for example, must answer a set of questions concern- 
ing who is served: Do poor people and members of minority groups 
have access to care? Are older people, children, addicts, and 
alcoholics served? When data demonstrate failure to comply, pro- 
cedural or structural changes in program may be required. Other 
questions may be generated by the interaction between program 
and community groups, by cash-flow problems, or by deficiencies 
identified through the utilization review process. Here, too, analysis 
of the problem may suggest changes in organizational policy, pro- 
cedures, or structure. 

Clarifying or modifying policy 

Unless new funds accompany the promulgation of new policy or 
an organization is able to reorganize to accomplish more with less, 
changes in policy tend to emphasize new tasks at the expense of old 
ones. In bureaucratic structures multiple constraints effectively 
limit the capacity for change, and the reorganizational ideal of doing 
more with less is rarely realized. The weight of laws and regulations, 
civil service or other labor/management guidelines, and hierarchical 
and multiple administrative structures, together with a separate 
planning structure, all conspire to make program managers feel that 
trying to accomplish more within their fixed resources is akin to 
swimming in shark-infested custard. Conversely, tying some priori- 
ties and not others to fiscal incentives can forcefully establish pol- 
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icy. Willie Sutton's law prevails. When asked why he robbed banks, 
he replied that he ''went where the money is/' Put in the language of 
the administrator; ''Show me which way the wind is blowing on the 
money tree and V\\ show you my priorities and policies/' 

In general, changes or clarification of policy precede changes in 
procedures, structures, technology, and individual behaviors. 
However, change in any of these areas can inadvertently or even 
deliberately lead to major modifications in institutional policy and 
priorities. In other words, changed structures or changed 
technology can also lead to changed policy. For example, today in 
our general hospitals an impressive new technology, computerized 
axial tomography (CAT), has led to new structures, demands for 
new resources, and, when funds were limited, to reallocation of and 
diminution of some old services; thus— new policy. 

With these caveats in mind, it can still b. argued that the first 
step in the redefinition of policy, or in reordering structures to bet- 
ter accomplish policy, is the collection and analysis of data. Mental 
health centers, drug and alcohol programs, and State-sponsored 
community clinics are required to collect data to show their com- 
pliance with policy mandates. Indeed, the development of quality 
assurance systems and the emphasis on creating organizational 
structures to evaluate mental health programs reflect policy deci- 
sions. Since resources are usually limited, evaluative activities tend 
to be restricted to those areas which affect the funding base. 
Patient*care evaluations are being emphasized because the costs 
can be built into the charges, and this type of evaluation is increas- 
ingly being mandated. Assessment of nontreatment activities 
(educat'on, prevention, consultation) is accorded a secondary or ter- 
tiary priority because of both funding constraints and difficulties in 
criteria development. 

An •xampl« of using data to 
chango policy and structura 

When the Connecticut Mental Health Center opened in July 1966, 
it expected to admit approximately 1,200 patients a year. In its first 
year 1,800 patients were served, and extensive waiting lists 
developed. In the second year, 2,400 patients were served. Staff in- 
sisted that more personnel were required to meet pressing clinical 
needs. They felt harassed, overworked, and overburdened. Institu- 
tional policy mandated that all who applied for care must be served, 
but the Center could find no new resources. A staff committee was 
charged with reviewing existing organizational structures and 
recommending appropriate change. The characteristics of ap- 
plicants and patients were also studied. 
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It was discovered that the modal social class of patients in treat- 
ment was lower middle class —patients who often had referring 
physicians or spokesmen within the community. Although referred 
in large numbers, poor patients, Blacks, and Puerto Ricans were 
under-represented. No regulations required the Center to specifi- 
cally treat the poor and underserved, but Center leadership insisted 
upon such service as policy. In the middle of the study year a 
waiting list was established that excluded almost all but emergency 
cases from care. Once again, 2,400 individuals were served. 

The committee recommended structural changes. An entry 
system was proposed for the Center that would evaluate all new ap- 
plicants for service, provide brief treatment for large numbers of 
them, and, when appropriate, refer them for service to other trea^ 
ment units. Establishing an entry system underscored a policy deci- 
sion to serve the poor and significantly increase their representa- 
tion in Center treatment programs. Since no new resources could be 
allocated for the reorganization, existing programs were examined 
to determine how staff might be redeployed for such an intake ser- 
vice. Thus, the data base required for decisionmaking now contained 
information about institutional resources and structures. 

At that time the Center had a free-standing day hospital which 
was the only resource available for continuing treatment of chronic 
psychiatric patients within the Center. This unit treated approx- 
imately 100 patients a year in an intensive group-oriented program. 
When it became clear that Center administration was committed to 
the development of an intake unit, senior clinical leadership decided 
to close the day hospital as an independent service, begin limited 
day hospital programs on the inpatient units using staff already in 
place on those units, and prepare the day hospital staff for reassign- 
ment during a 6-month period. Half the personnel were then as- 
signed to an entry unit; the other half were assigned to a continuing- 
care service established to deal flexibly with the chronic patient 
population through medication clinics» socialization and rehabilita- 
tion activities, and a variety of group therapies. Approximately 80 
of the patients previously treated in the day hospital could be 
managed within the community by this new service. Following this 
reorganization and the addition of a drug dependency program, the 
number of patients served by the Center rose dramatically to 3,600 
in its fourth year of operation. The number of chronic patients main- 
tained in the continuing-care service climbed to approximately 250 
and is now over 750. 

The example demonstrates how an examination of data and a 
careful consideration of alternative resource allocation permitted a 
program to vastly extend its services without expanding its 
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resources and without significantly diminishing the treatment 
modalities available to patients. 
The steps included: 

1. The development of data which demonstrated 
areas of service deficiency (similar to a profile anal- 
ysis); 

2. Commitment by administration to a policy of ade- 
quately serving those presenting for care; 

3. Examination of available resources (no new 
resource available, re-examination of existing 
resources); 

4. Establishment of a process which included relevant 
individuals in the decisionmaking process (involv- 
ing senior clinical managers in the process led to 
organizational changes and to early communication 
with affected staff about proposed changes and the 
rationale for change); 

5. Development of a change strategy (no staff would 
lose jobs; staff would be adequately retrained for 
new responsibilities and carefully supervised for 
some period of time in those new responsibilities); 
and 

6. Continual reassessment of organizational changes 
and feedback to the organization. 

Important tools, in effecting change were the clear articulation of 
generally accepted values and redefinition of value hierarchies. To 
deal with the concern that increasing work load would lead to less 
intensive and less "good*' care, management insisted that equity of 
access and equality of service had highest priority. The Center's 
responsibility to surrounding community was emphasized and re- 
emphasized. In addition, management insisted that a more effective 
entry system would lead to better utilization of therapy time and, 
thus, to fewer drop-outs. 

Following the organizational change, the feedback showed a 
dramatic increase in the number of individuals utilizing services. At 
the same time, a significant change in the demographic 
characteristics of clients demonstrated that services were far more 
accessible to members of poor and minority groups. 
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A ••cond example 

Several years later, review data and comments from Hispanic 
community leaders made it quite clear that the Center was not serv- 
ing the area's Puerto Rican population. Some insisted that Spanish- 
speaking individuals underutilized traditional medical and 
psychiatric resources, preferring ''native healers," Utilization 
records of a local neighborhood health center were examined and 
showed unequivocally that Spanish-speaking individuals actively 
seek medical and even psychiatric services when offered by a health 
center and delivered by Spanish-speaking professionals. 

Based on these findings, the Center decided to change its 
organizational structure. In discussions with community groups, a 
commitment was made to recruit a Spanish-speaking psychiatrist to 
head a special Spanish Clinic that would be part of the Center's in- 
take and assessment services. Since the number of individuals who 
might use such a clinic was unknown, several staff positions within 
the intake and assessment service were allocated for new bilingual 
and bicultural staff who would be assigned part-time to the Clinic. It 
was explicitly stated that the new recruits were to spend as much 
time in the clinic as the workload warranted. 

Again, the elements were similar: data evidencing need, affirma- 
tion of policy, commitment of administration, analysis of resource 
availability and appropriate reallocation of resources, involvement 
of senior clinical management, clarification of value hierarchies 
(equity), and, during the implementation phase, allocation of posi- 
tions to the new clinic. Finally, the process of organizational change 
was monitored and frequently re-evaluated. Once again the 
organizational change was effective, and the numbers of Hispanic 
patients using services dramatically increased. 

Changing organizational procedures 

While structural changes are most dramatic, changes in pro- 
cedure or in individual practices may be of even greater import to 
an organization and its clients. Procedures may be changed by in- 
tervention at multiple levels within the system. The changes 
themselves may result from concurrent or retrospective review ac- 
tivities. A clinical care evaluation study, by exploring a range of 
therapeutic and diagnostic activities, can identify unit or institu- 
tional deficiencies calling for important procedural changes. CCE 
studies on topics such as medication practices (e.g., which outpa- 
tients receive prescriptions for minor tranquilizers over many 
months* which ones are on high doses of medication, etc.) or com- 
pliance or noncompliance with therapeutic recommendations can 
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highlight areas needing better institutional procedures (e.g., recom- 
mendations as to prescription practices, polypharmacy), or the use 
of various discharge categories. 

In one CMHC setting, a series of clinical care evaluation studies of 
Center patients transferred to State hospitals and State hospital pa- 
tients referred for aftercare to the Center revealed major gaps in 
continuity of care. Analysis of the study results led to several pro* 
grammatic changes. A special liaison team was established to 
facilitate transfer of patients. Within the Center, staff responsible 
for the patients* aftercare were assigned part-time to the Center's 
emergency service because the data showed that the index popula- 
tion not only tended to use both the emergency and chronic care ser- 
vices extensively, but were more likely to be hospitalized when 
seeking crisis care from the emergency service. 

The organizational changes reduced hospitalization of these pa- 
tients, improved liaison between services and institutions, and 
enhanced continuity of care. FoUowup studies, however, identified 
major problems in record retrieval. Only 20 percent of the patients 
discharged from the State hospital had hospital summaries noted in 
Center charts. Specific procedures were developed by both institu- 
tions collaboratively, and record-sharing dramatically increased. 

Even when structural change has been accomplished, careful at- 
tention should be paid to procedural issues to assure quality care. 
As in other aspects of the quality assurance cycle* work is not com- 
plete without a followup restudy of the change procedure. 



CONCLUSION 

Priorities for review are established in the same manner as 
priorities for service. Mandated reviews must have precedence; 
reviews of problem areas ought to have precedence. While profile 
analyses, clinical care evaluation studies, and concurrent review 
provide impetus for change, the organization's administrator should 
not be bound by the inherent limitations in such studies. It is impor- 
tant to remember that numbers can be used to justify dramatically 
opposite policies. When used within a clearly defined policy context, 
however, review data can effectively demonstrate how a policy is 
being implemented. The power of the data though is not in th^ 
numbers but in the use of the numbers to underscore a moral im- 
perative: '*We are not doing as we ought. We have responsibilities 
that are unmet and that tr£inscend other values.'' To some extent 
the capacity of an organik:;ation to change reflects current internal 
and external political realities, and data are of value in that context 
or in changing that context. 
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Evaluation in and of itself has an impact upon the organization. It 
sensitizes practitioners to the necessity for review. It establishes 
"limits/* identifying expectations as to practice. Patterns of care 
tend to become more routinized and individual differences limited. 
The danger, of course, is that meaningful innovation will become im- 
possible and that the art of care— a humane, dignified approach to 
the patient— will be a casualty of increasing bureaucratization. 

Organizational reviews are to a large extent constrained by the 
available data and the capacity to organize that data. So far, much of 
the work in mental health care is poorly quantified. The model 
described here uses data to change structures and procedures and 
has important checks built into it. It acknowledges the importance 
of policy and examines data within the context of policy and prac- 
tice. It attempts to involve relevant individuals in the process of 
organizational change and highlights the importance of change 
strategies which attend to both patient and staff needs. 
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Chapter S«v«n dlscuss«s considera- 
tions In locating tha rasponslblllty for 
quality assuranca activltlas within tha 
CMHC by (l)prasantlng a ganaral 
thaory off tha structura of tha organiza- 
tion, tha natura of taaks, and asslgn- 
mant of priorltlas for task accompllsh- 
manta; (2) daflning authority raiatlon- 
shlps and apacialixad rofa functions; 
and (3) ravlawlng organizational plac«- 
mant and managamant of a utilization 
ravlaw commlttaa and tha rasourcas ra- 
qulrad for Its propar oparation. 




I. EY TOPICS 



• Primary task 

• Boundary relationships 

Entry, transformation, and export 

• Center management 

Administrative regulatory functions 

Skill pools 

Committees 

• Organizational implications for review of care 

The hospital and the organized quasi- 
independent medical staff 

• Centralized and decentralized CMHCs and 
organizationally contained professional and/or 
medical staffs 
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In order to know where to locate quality assurance activities in an 
institution, we first need to understand something about the nature 
of organizations. For example, a series of questions might be asked 
about an organization: 

What are the tasks of an organization? 
How are priorities assigned? 

How are the parts of the organization identified; how 
are they managed; how do they relate to each 
other? 

How are decisions made? 

What is the nature of the organization's transactions 
with its various environments? 

How are organizational/environmental transactions 
managed? 

Do different occupational groups within the organiza- 
tion have roughly equal influence, or do some 
possess greater authority and/or autonomy? 
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What are the consequences for task accomplishment 
of locating quality assurance structures in differ- 
ing sectors of the organization? 

All organizations have implicit or, more often, explicit definitions 
of authority relationships and specialized roles in regard to task per- 
formance. Thus, examining an organization's structure should 
reveal its tasks, its task priorities, and its image of the appropriate 
way of ordering work relationships. 

A number of conceptual frameworks are available to describe 
organizational structure and function. Most managers are familiar 
with the Christmas tree approach to schematizing organizations 
which identifies line and staff functions separately. The authors' ex> 
perience, however, suggests that the system evolved by A. K. Rice 
and Eric Miller (Rice 1963; Miller and Rice 1967) has particular value 
for medical, psychiatric, and psychological treatment facilities. 

Rice and Miller stated that, if the structure of any organization is 
examined, its primary toik^the one task that an organization must 
accomplish in order to survive -could be identified. This method 
would accurately identify primary tasks for the organization as a 
whole and for its subsectors. In other words, by looking at the 
organization of tasks and the way authority is defined and boun- 
daries managed, the purposes of the organization would be clarified 
or, alternatively, confusion about goals would be made evident. 
Building on this concept, the authors have developed a framework 
for examining problems within psychiatric and psychological treat- 
ment settings. 



THE ANALYTIC FRAMEWORK 

In this framework, the organization is an open system. Open 
systems constantly interact with their environments. They consist 
of three major subsections: entry, transformationt and export (see 
figure 29). The entry subsystem is responsible for bringing appro- 
priate supplies into the system at appropriate rates, as efficiently as 
possible. The supplies are altered within the organization— mate- 
rials are utilized and products are made or, as in the context of men* 
tal health organization& services are provided— by the transformij^ 
tion subsystem. Finally, the new product— or changed person— is 
exported by the export subsystem to the environment. The process 
generates new resources which enable the organization to continue 
the process. 
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Thm Organization as an Opan Systam 
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EV— Environment 

E —Entry Subsystem 

T —Transformation Subsystem 

X ^Export Subsystem 



Boundary Relationships 

Figure 30 shows the internal and external boundary relation- 
ships. The entire organization is separated from its environment, 
and its subsystems are separated from each other and from the 
managerial function that relates the organization as a whole to its 
environment. The diagram depicts a boundary as a region of trans- 
action; transactions occur between the organization and its environ- 
ment and among the subsystems. A major managerial task lies in 
regulating these transactions to preserve organizational integrity 
and vitality. Managers must ensure that the organization is not 
flooded by entries from the environment or that one subsystem is 
not flooded by entries from another. Maintaining organizational 
vitality means ensuring that the entry, transformation, and export 
of material or people by the organization occur at a rate sufficient 
to keep it from entropy and de-differentiation. Thus, the organiza- 
tional boundary is not a barrier, but a carefully managed region of 
exchange. 
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MOrg— Management of the Organization 
ME —Management of Entry 
MT —Management of Transformation 
MX —Management of Export 
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Rice's focus on primary task permits us to schematize an 
organization by first seeing where the boundaries are placed. Since 
the structure of the organization ideally serves its primary task» the 
boundaries should maximize accomplishment of the work the 
organization is set up to do. 

Administrative Regulatory Structures 

Rice uses rectangles to identify managerial functions. The con- 
vention avoids the necessity of drawing boundaries within boun- 
daries (see figure 31) and shows clearly that the role of organiza- 
tional management is to (1) relate the entire organization to its en- 
vironments and (2) manage the interaction of the parts of the 
organization. 

The relatively simple structure becomes more complex when we 
attempt to locate the administrative functions within the organiza- 
tion. Administration is not identified as a line function within the 
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ARFki— All Other Control Functions 



organization, as, for example, another branch in a more traditional 
organizational diagram. Rather, administrative activities — budget, 
personnel, plant operations, and the like— are regarded as a set of 
functions which serve to regulate work. Traditionally, these func- 
tions are under the direct control of the executive function of the 
organization and are critically important to the successful ac- 
complishment of managerial tasks. These functions are not located 
in any major activity area (i.e., entry, transformation, export) since 
they assist management in regulating the internal environment of 
the total organization, in planning, and in monitoring work. As an 
example, budgetary functions and personnel activities affect all the 
line units within the organization and are therefore placed to show 
their role in the total organization. 

Skill pools 

The organization must appropriately deploy its human resources. 
One way of conceptualizing this is to consider individuals as 
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members of identified skill pools, schematically represented by 
circles (see figure 32)» 

Within the organization, individuals are differentiated by skill 
level, training, status, and salary, but their needs also influence 
organizational structures. Their loyalties and commitments to 
subgroups, colleagues, etc., may be as important as commitment to 
work, perhaps even more important. To help in conceptualizing 
these issues, individuals are first identified by membership in cer- 
tain "skill pools,"* 

Individuals from one skill pool may work in a number of different 
organizational structures. For example, one social worker may func- 
tion in an entry structure in a mental health facility, performing in- 
take functions. Another social worker might be primarily engaged 
in a specific transformation function— such as family therapy. A 
third might be working primarily in an export function, managing 
liaison with community agencies which receive discharged clients. 

Individuals may be pulled by diverse and sometimes conflicting 
claims upon their personal commitment— to work groups, organiza- 
tional subunits, skill pools, or professional associations, for example. 
Although the primary commitment might be to their unit or their 
discipline, their commitment to task (undertaken primarily through 
the unit) might at times be compromised by disciplinary issues (e.g., 
status of disciplinary group, as reflected by the authority of a 
disciplinary chief). 

To avoid these conflicts in their staffs, subunit managers may 
routinely set up task boundaries to encompass areas of personal 
commitment also, thus discouraging individual staff members from 
engaging in extraunit activities or developing extraunit loyalties. 
Though this expedient often builds excellent intragroup working 
relationships, it may impair the accomplishment of required work if 
group norms regarding interpersonal behaviors assume priority 
over task accomplishment. Locating task and loyalty boundaries 
together may further lead to isolation of a unit, may be a powerful 
impediment to changing structure or goals, and may lead to group 
demoralization if major leadership figures leave. 

From an organizational perspective, skill pools should be re- 
garded as a staff function under the direct control of the chief ex- 
ecutive. Designating an organizational base for a disciplinary group 
confirms the legitimacy of disciplinary identification. It also allows 
disciplinary skills to be emphasized, and continuing education needs 



*Rice and Miller (1967) as well as Rice (1963) used the concept of sentience to describe 
the personal and group needs of individuals. Edelson (1970) preferred the term ''skill 
pool" to show that the organization is interested in these areas of individual and 
member needs in order to structure them in the service of task accomplishment. 
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to be identified. It further facilitates consultation for operating 
units about the education, skills, and potential of discipline 
members. In addition, organizing by discipline helps to coordinate 
recruitment and to identify qualiHcations for promotion (within a 
specific framework). The disciplinary group should not compete for 
line authority with organizational units. Such competition subjects 
individuals to the conflicts of multiple subordination (Henry 1954) 
and interferes with the ability of the organization to accomplish its 
work. 

Commltta* Structure 

To complete the organizational framework, committees are 
developed to relate organizational activities, regulatory functions, 
and skill pools to each other. Thus committees engage in intergroup 
activities, arguing and compromising diverse positions and 
priorities. Committee structures are depicted on the organization 
chart as ovals (see figure 33). Committees can be viewed as ex- 
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tremely frustrating and the loci of organizational confusion if 
members misunderstand their tasks and influence. While commit- 
tees may be charged with exploring significant issues and monitor- 
ing organizational activities, their authority devolves from the 
organization's administration. They assist management in problem- 
solving by reflecting and seeking to meld together a wide range of 
expert opinions. Committee appointments generally are initiated or 
confirmed by executive action* Staff support is assigned administra- 
tively. Committee decisions must be implemented through organiza- 
tional administrative channels. Effective committees usually have 
the majority of their actions confirmed, although administrations 
have rejected even well-considered committee recommendations. 

Committees are not management groups. Management groups, 
e.g., executive groups, have decisionmaking responsibilities and are 
clearly part of an organization's formal hierarchical structure. The 
executive constellation (Hodgson, Levinson, and Zaleznik 1965) is 
shown in figure 33 by the symbol ''EX/' Committee or skill-pool 
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representatives and other administrative staff report to the ex- 
ecutive group. In other words, the committee's role is advisory. A 
committee may problem-solve and recommend, but for action to be 
taken executive approval must be obtained. 

A More ComplM Organization 

Most organizations are far more complex than those described so 
far. Figure 34 schematically presents a more complex organization 
with two major components in the transformation function. These 
might represent two manufacturing plants, or two major technolo- 
gies within one plant. In a CMHC, the two components of the 
transformation function might be clinical services and consultation/ 
education services. Each area could be further subdivided into 
operational units (i.e., clinical services can be subdivided into am- 
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bulatory care, partial hospitalization, inpatient services, emergency 
services, etc.). 

Regulatory and skill-pool functions must be located at the ap- 
propriate level of the organization. This means that, depending on 
organizational size and complexity, some of these functions may be 
found at several organizational levels. For example, a manufactur- 
ing corporation might need to assign some engineers to multiple sec- 
tors of the organization. Thus engineers in SPi might recruit 
engineers for the corporation and develop skills in young engineers 
by assigning them to several areas within the corporation. Other 
engineers may work in manufacturing and would thus be located in 
skill spi which supplies engineers to both manufacturing plants (or 
subunits). Other engineers with very specialized skills might be 
located in only a particular plant (sp,) or even a particular unit of 
that plant. 

Similarly, social workers in SP, might be recruited for work in 
programs throughout the entire facility -in entry, transformation, 
and export areas. Conceivably psychologists might be emplo sd 
only in transformation functions either as clinical therapists or as 
consultation/education specialists. Their disciplinary skill pool 
would be located at spi. Recreation thjrapists might be located in 
only one section of the transformation area, and their skill-pool loca- 
tion might be spj. 

APPLICATIONS 

The analytic framework described is useful for obtaining a rough 
idea of the anatomy of the organization but does not show how well 
an organization functions or how imaginatively and creatively its 
people perform. However, when the structure is examined, it is 
possible to identify implicit organizational priorities and spot poten- 
tial problems. In the following examples* the analytic framework is 
applied to several actual organizations. 

EXAMPLE 1: The first organization considered (see figure 35) is a 
mental health center with three major semiautonomous com- 
ponents: two community clinics (providing intake, outpatient care, 
day treatment, and active consultation and education programs) and 
a hospital-based inpatient and emergency service. Discussions with 
center personnel uncovered a major problem area: the director of 
Community Clinic 2 felt that her unit was not receiving a fair share 
of center resources. Other staff and executives disagreed about 



•In these examples, certain organizational aspects have been altered to preserve in- 
stitutional anonymity. 
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whether or not the clinic was being shortchanged, but they all 
acknowledged major interpersonal difficulties among the three divi- 
sional heads. 

Examining the structure revealed the true nature of the problem 
and suggested its solution. The physician head of the inpatient and 
emergency services (IPES) also chaired the medical end profes- 
sional staff group. Consequently he could apeak for qua^Hy-of-care 
issues in the organization. The director of Community lie 1 also 
managed the fiscal office of the center. Thus, whenever disputes 
over resources arose, discussion was short-circuited because the 
managers of Clinic 1 and the IPES could act from regulatory control 
and committee bases, as well as from line managerial roles, thus 
bypassing the head of Community Clinic 2. Decisions were made 
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without involving the center director or the board. Rather than be- 
ing recognized as an organizational issue, the problems were 
routinely ascribed to personality differences among the three key 
managers. 

Not surprisingly, managers often act to increase their influence 
on decisionmaking in the organization. A manager who occupies 
both a line managerial position and a major committee or regulatory 
group chairmanship is in a position to short-circuit normal institu- 
tional processes in the allocation of resources and the definition of 
priorities. Under such circumstances, problems among managers 
competing for resources may easily be misascribed to interpersonal 
difficulties. 

EXAMPLE 2: In community mentul health centers, accessibility 
and availability are usually incorporated into the design of services. 
Multi-disciplinary teams are involved in assessment and treatment. 
Nevertheless, services continue to be discontinuous, and patients 
get lost in the interstices between treatment programs. Signifi- 
cantly, the definition of treatment elements does not necessarily 
lead to clarity and effectiveness of organizational structure. 

Figure 36 depicts a common structure for a community mental 
health center. The center has two community clinics, each with a 
local board. Tasks within each clinic are organized into entry, 
clinical, and consultation and education services. The clinical ser- 
vices offer three locally delivered types of treatment (for example, 
outpatient, aftercare, and day hospital treatment). This particular 
center contracts with a general hospital for emergency services and 
inpatient treatment. 

Even a cursory exammation of this diagram reveals serious 
organizational issues. The Emergency and Inpatient Services 
report to two institutions with different administrative structures 
and different views about professional functions and interrelation- 
ships. Center management must, therefore, carefully define center- 
hospital interactions in order to maintain some control over both the 
utilization of center resources and the availability of services to 
center patients. To ensure that patients are not lost between ser- 
vices and that the psychotic patient population does not become a 
focus for interunit conflict, inpatient service leadership must par- 
ticipate on center committees. Clinic entry services must work out 
clear relationships to Hospital (Center) Emergency Services so that 
patient flow serves individual treatment needs. There are no struc- 
tures to manage patient flow (export), and these probably should be 
developed center-wide (e.g., a center placement committee to 
manage interunit transfers). 
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FIGURE 36 
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The questions of authority and its exercise are highlighted by the 
diagram. Responsibility of boards for programs must be made quite 
explicit lest boards begin to feel impotent or subject to unwarranted 
interference. The model of a medical staff in one institution will 
raise questions about appropriate staff structure within the center, 
questions that cannot easily be resolved. The authority issue is fur- 
ther confounded by clinicians assuming managerial roles. For exam- 
ple, when physicians write orderc, are they acting as professionals 
(M.D.'s), who are using the authority that comes from their special- 
ized knowledge, to instruct others (e.g., nurses) while maintaining a 
colleague relationship? Are they functioning as senior members of a 
hierarchical organization using bureaucratic authority? Or, does the 
act of writing an order invoke different forms of authority at dif- 
ferent times? 
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In the general hospitali the physician is still most often an in- 
dependent practitioner. From this perspective the physician rarely 
considers management issues except as impediments to practice. 
Physician-employees who act as clinician-managers are often con- 
fused about the nature and legitimacy of authority. They rarely 
think about, and even more rarely are taught about, changing role 
requirements as they move from independent practitioner to clini- 
cian-manager. Thus, bureaucratic requirements to function within 
constraints identified by union-management negotiations may be 
viewed as inappropriate to good patient care. Requirements to docu- 
ment behaviors and to monitor performance may be eschewed, 
leading to inconsistent management and the arbitrary delegation 
and withdrawal of authority. Line managers must always have the 
capacity, the authority, and the inclination to manage. 

EXAMPLE 3: Several years ago, a private psychiatric hospital ex- 
perienced some management difficulties. The hospital's organiza- 
tional charts, shown in figure 37, clearly reflected the source of part 
of the problem. For example, roles of executive director and medical 
director were not differentiated, no clear entry structure existed, 
and line functions were confused with discipline structures. In an at- 
tempt to recast the organization into our diagrammatic format, the 
clinical programs were examined first (see figure 38). Five major 
units were identified: an alcohol and drug program; two adult 
buildings and one adolescent building; and a day hospital program. 
The family therapy program comprised a loose configuration of 
therapists who worked on different units but who were assigned to 
patients and their families centrally. This component was primarily 
a skill pool serving the clinical units by monitoring practice, setting 
standards, and assisting in education. The occupational therapy and 
activities program functioned the same way. 

The senior executive constellation was indefinite about the rela- 
tionships among executive director, medical director, and ad* 
ministrator. It was not clear whether they formed a directorate, or 
whether the medical director had sole responsibility for clinical pro- 
grams while the administrator was responsible for regulatory func- 
tions. The school and research facilities seemed to be relatively 
separate from clinical operations and were depicted as separate line 
funtions. 

The location of nursing and psychology was initially vague. If 
they served as major skill pools for clinical, school, and research 
areas, they should have been located in the sector indicated, but if 
their function was primarily in the clinical area, perhaps they should 
have belonged with the family therapy and occupational/activity 
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therapy skill pools. The marketing and educational function was a 
small office involved in establishing continuing education programs 
and in maintaining relationships with referring professionals. 
Because it was run by an elderly, respected psychiatrist, it was not 
considered a component of administration. 

The task at hand was to rationalize the organization. Because 
issues of resource allocation were of major importance in the defini- 
tion and refinement of organizational structural proposals, a com- 
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prehensive budget review was^undertaken. After much consulta- 
tion, the organizational structure shown in figure 39 was developed. 

The establishment of a neuropsychiatric evaluation unit to serve 
as an entry system for the entire clinical operation was recommend- 
ed. That system would deal with referral sources, conduct initial 
comprehensive evaluations, and develop initial treatment plans. 
Following evaluation, patients would be referred to a full range of 
in- and outpatient services within the hospital complex or returned 
to referring sources. (In the past, the exit processes from the 
hospital were unstructured and arranged on a case-by-case basis.) 
Resources for a new entry unit were not immediately available, so it 
was suggested that 12 beds in one of the adult units be converted to 
this purpose. 

Establishing new beds would, of course, require Health Services 
Administration (HSA) approval. No regulatory approval would be 
necessary, however, to start up small ambulatory programs and pro- 
fessional support to transitional living arrangements. The day pro- 
gram was advised to develop transitional settings (halfway houses. 
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supervised apartments) and serve as a base for a comprehensive in- 
stitutional ambulatory program. 

An individual therapy skill pool whose members might serve pa- 
tients in a wide range of settings was identified and located under 
the direct control of the manager of the clinical program. Group and 
milieu programs were not handled the same way because they 
seemed to belong to specific units. For example, the group program 
on the alcohol and drug program was quite different from group pro- 
grams on inpatient units. These, in turn, were different from pro- 
grams that might evolve in ambulatory settings. At least initially, 
these functions should be controlled at the unit level. 

The establishment of a clinical chiefs group was recommended to 
monit^or quality of care, develop clinical policies, and facilitate pa- 
tient transfer (through subcommittees) among units. The direc- 
torate of the hospital was changed to include the executive director, 
the medical director, the administrator, and the director of nursing. 
This seemed to make sense since the clinical operation accounted for 
over 85 percent of institutional resources. The medical director was 
also identified as chief of clinical programs. The psychology skill 
pool was moved to the institution level because psychologists were 
actively involved in school and research programs as well as the 
clinical operations. An educational committee was established. 
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chaired by the head of the original educational function. However, 
marketing was really a responsibility of administration. Thus ad- 
ministration became responsible for providing the logistical support 
for educational activities and exploring marketing strategies as in- 
dicated. 

This strategy helped the organization clarify its task systems and 
its structure while pursuing its goals of providing high-quality ser- 
vices, maintaining adequate patient flow, and ensuring fiscal in- 
tegrity. The process clarified work relationships among managers, 
identified structures mislocated in relation to task requirements, 
and distinguished between structures used to deal with the needs of 
persons or groups and those primarily addressing task needs. 

ORGANIZATIONAL IMPLICATIONS FOR REVIEW 
OP CARE 

Quality assurance activities are located in organizational struc- 
tures in ways which are designed to facilitate work. The relative 
autonomy of professional groups also has impact upon where these 
activities will be located. In this section we will look at three dif- 
ferent institutions -the hospital, a centralized CMHC, and a decen- 
tralized CMHC-in order to examine the impact of differing 
organizational contexts, interprofessional role hierarchies, and in- 
tergroup conflicts upon the location of quality assurance activities. 

Thm Hospital 

The modern hospital is a good example of an organizational struc- 
ture similar in important ways to other health care and human ser- 
vice organizations but with important differences also. Hospitals 
are usually multimillion-dollar operations that, to a very jiarge ex- 
tent, depend upon the referral practices of physicians in thercom- 
munity, not on the activities of their employees. A hospital's vitality 
depends upon its bed occupancy. Physiciana control entry into 
hospital beds. Thus hospitals compete for physicians and only in- 
directly for patients. The extraordinary development of medical 
technology attests to the conviction of hospitals that if they cannot 
offer the most extensive services they will lose out in the competi- 
tion for doctors, and patients will be admitted elsewhere. 

Problems of Entry 

In a peculiar way the hospital provides a model for entry for 
health and human service institutions. The applicant for service 
usually is related to a specific professional who, in turn, is often 
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responsible for initial workup and services within the system. The 
hospital's role in the entry process generally is administrative (e.g., 
determining whether the patient has funds to pay for care, process- 
ing forms so that the individual is identified as being within the 
system, providing the individual with laboratory, clinical, and 
housekeeping services, etc«). The system works reasonably well for 
those individuals who have physicians; it works poorly for those 
who don't. These individuals can enter a hospital only through 
emergency services or specialty clinics. Usually, no well-designed 
structure enables them to move from the hospital into outpatient 
care* In a prior generation, they became charity cases. Today, they 
may be assigned to junior staff members or advanced trainees. 
Their entry into the system is precarious. Even when entry is ef- 
fected, they often have no ongoing relationship to a physican in a 
setting where a close physician-patient relationship is critically im- 
portant for ensuring adequate care. 

The Export Function 

In health and human service organizations, export structures are 
even generally less developed than entry systems. Administrative 
systems may follow the patient to the community via billing and in- 
surance procedures, but clinical-care connections usually are 
limited. The hospital may send some individuals out into its am- 
bulatory services, and the needs of some few patients for 
community-based social and rehabilitative services may be managed 
through a small social-work department. However, the hospital 
generally pays little attention to planning for the complexities of 
post-hospital care. To an extent some of these 'iacks*' are made up 
for by ex-patient groups (laryngectomy groups, colostomy groups, 
etc.). However, most hospitals view almost all their efforts as prop- 
erly located in the transformation area. 

The Medical Staff in the Organizational Structure 

The medical skill pool is in and out of the hospital and, generally, 
has a uniquely defined relationship to the hospital's board through 
its joint conference committee (see figure 40). This committee is re- 
quired by the Joint Commission on Accreditation of Hospitals. It 
brings together members of the hospital board, the hospital ad- 
ministrator, and members of the medical staff to ensure that 
patient-care needs will be routinely addressed by the board as it 
considers policies and priorities. Thus the medical staff is and is not 
part of the hospitaFs table of organization. This leads to two lines of 
accountability within most hospitals: physicians are responsible for 



ERIC 




136 



Quality Assurance in Mental Health 



PiQURE 40 



Th« Hospital (Organiiationai Structure) 



EV 



lEEl t^'^'*H-" H fc f 




MAmbs 



ObQyn 



MAmbs— Management Ambulatory Services 
MIPS —Management Inpatient Services 
1* Care— Management Primary Care Unit 
ES —Management Emergency Services 



ERLC 



patient care, and staff arr separately accountable to them and to 
hospital administration. Clearly this is an issue which has only 
recently been recognized by hospital administrators and boards 
(Neuhauser 1978; Smith 1956). 

The physician tends to view the hospital as an extension of his of- 
fice (see figure 41). Even the limited entry and export functions tend 
to be dismissed as unnecessary or as administrative trivia. As the 
'^doctor's workplace/' the hospital serves his needs, his view of what 
is necessary for the beat patient care. However, the physician ex- 
pects this complex system to function well without activities being 
organized (or at least not his activities). Thus, medical, nursing, and 
dietary services are often at odds with one another, with doctors ex- 
pecting their orders to be routinely and expeditiously executed 
even in areas other than direct patient care. 
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Organizational Implications for Review of Care 

In the hospital, review of care is almost entirely identified with 
review of medical activity. Care delivered by other professionals or 
nonprofessionals is regarded as under the direct supervision of 
hospital administrators who monitor it through individual perfor- 
mance evaluation. Thus, the logical place for admission certification 
and length-of-8tay certification activities is with the utilization 
review committee and its physician members so that issues can be 
resolved peer to peer. 

Quality assurance activities are organizationally problematic. 
They relate directly to the medical staff, but as part of hospital 
management they must relate to administration. 

Medical care evaluation studies and profile analysis are important 
administrative tools. Responsibility for effectively undertaking 
those activities might reside either within the hospital's ad- 
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ministrative structure or with the medical staff. It is clearly in a 
hospital's interest to exert some control over these activities and in 
this process to begin exerting some significant influence over the ac- 
tivities of the medical staff. We can anticipate that one effect of the 
development of more formal quality assurance programs may be 
some redefinition of and attempts to constrain the role of physician 
within the hospital. 

The Community Mental Health Center 

In the consideration of where to locate a quality assurance struc- 
ture within a CMHC, several organizational issues need to be taken 
into account. First, within most centers, the professional staff, in- 
cluding physicians, are employees and are bound by institutional 
regulations and practice. Although the professional staff must have 
responsibility for the quality of care within the institution, the loca- 
tion of discipline groups and a professional and/or medical staff 
organization is internal to the center. The professional and/or 
medical staff is not a boundary group. 

Assigning quality assurance activities to a medical and/or profes- 
sional staff body gives that staff both regulatory and skill-pool func- 
tions. This confounding of tasks can lead to the development of a 
strong professional group which might conceivably lead to clinical 
staff/managerial difficulties. Nonetheless, such combining of tasks is 
important because a strong, committed medical and/or professional 
staff can have dramatic impact upon its members, monitoring in- 
dividual compliance with generally accepted criteria and 
stimulating and supporting staff educational activities. 

The utilization review committee (URC) should also report dir- 
ectly to center management profile data and results of clinical care 
evaluation studies. Information about individual practitioners 
should be referred to center management only via the professional 
staffi but other data can be forwarded directly by the URC. 

Such organization builds into the utilization review committee 
the potential for reflecting conflicts between medical and/or profes- 
sional staff and center administration. Unlike the hospital, the pro- 
fessional and/or medical staff have no way of circumventing admin- 
istration in negotiating resource demands for clinical needs with 
center management who are responsible for accomplishing the 
multiple tasks of an organization (e.g., outreach programs, consulta- 
tion and education programs, in-staff training, affirmative action 
programs for employment upgrading) within defined fiscal limits. 
The organization also benefits by having structures in which these 
issues can be debated. 
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Figure 42 diagrams a somewhat idealized quality assurance struc- 
ture in which the URC is accountable to an organized professional 
staff that has explicitly defined institutional responsibility for the 
quality of care. One of the most useful aspects of designing a URC is 
clarifying who is responsible for the quality of care, an issue poorly 
defined in most mental health facilities (even those with medical 
and/or professional staff by-laws). If the medical and/or professional 
staff has not been delegated responsibility for clinical care, the URC 
should be located as a committee of that group which does have such 
responsibility. 

A Centralized CMHC 

Figure 43 represents a relatively centralized community mental 
health center with two decentralized services providing local in- 
take, clinical, and consultation and evaluation services. Emergency 
and inpatient services are centrally located with core adminis- 
trative activities and special programs (a substance-abuse unit). In 
this setting a utilization review committee can report directly to the 
professional and/or medical staff and tie into organizational manage- 
ment. The utilization review committee serves as an important 
regulatory body for the entire institution, as well as overseeing 
clinical care activities within the institution. 
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A Decentralized CMHC 

The CMHC shown in Figure 36 (page 129) and described in Exam- 
ple 2 represents a rather typical decentralized center. It contracts 
for its emergency services and inpatient treatment with a general 
hospital that has its own utilization review committee and medical 
staff organization reporting into its own board. 

Some decentralized centers may have professional staff organiza- 
tions, but this model center has no specific utilization review com- 
mittee. A variety of options are open in regard to utilization review 
and peer review: 



1. The general hospital's utilization review commit- 
tee, as part of its routine functions, will have 
responsibility for reviewing admissions, extended 
stay, and so on, on the psychiatric ward. The CMHC 
might contract with the hospital for the total spec- 
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trum of activities required » including medical care 
evaluation and profile analysis; 

2. The center might establish it own utilization 
review committee responsible to a professional 
and/or medical staff organization. The committee 
might insist upon its legitimate review functions in 
regard to concurrent review (admission certifica- 
tion and extended stay) and retrospective as well 
as medical or clinical care evaluation studies and 
profile analysis. That is, the CMHC could compete 
with the hospital for the right to review activities. 
However, this strategy is almost always feckless. 
Hospital review practices will be in place well 
before most CMHCs have even begun to consider 
how to establish review structures; 

3. A third option might be to have each community 
clinic separately evaluate its own clinical care and 
to delegate the responsibility for evaluation of hos- 
pital care episodes to the general hospital's utiliza- 
tion review committee. The hospital, in other 
words, would conduct concurrent review activities, 
profile analyses, and clinical care evaluation 
studies. In this decentralized review model the 
center would conduct all those studi?>!S which cross 
clinical unit boundaries. Since an institution learns 
a good deal about itself by developmg clinical or 
medical care evaluation studies and profile analy- 
sis, it is in the institution's interest to exert some 
direct control over these acti/ity areas in order to 
anticipate the need for change and then to plan for 
redefinition of program or reallocation of resources; 

4. The center might join with other centers to 
develop mechanisms to ^h&re resources to collabor- 
atively develop profiles and conduct clinical care 
evaluation studies. Staff sharing might also enable 
centers with few pro'^^ssionals to conduct concur- 
rent review attivitie Dy clinicians who are not 
directly providing the bulk of the center's services. 

Resource Allocation 

The work of a utilisation review committee demands adequate 
staff. At the very least, staff must be available to do admission cer- 
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tification of high^cost clinical activities. Resources are also required 
to undertake clinical care evaluation studies and profile analyses. 

Although it is important that the utilization review committee be 
independent of the medical records section, it must be able to com- 
mand resources and collaboration from medical records. As part of 
the overall administrative structure of the facility, the major task of 
the medical records section is to ensure that adequate records are 
available to assist clinicians in the provision of care. Its secondary 
task is transmitting and retrieving records from other car« givers, 
again to enhance care. If the records section is also asked to assist in 
peer review, it must have sufficient staff to accomplish this work in 
addition to its primary tasks. When there is conflict about allocation 
of resources or when resources are scarce, the medical records sec- 
tion will naturally focus on the tasks of highest priority. 

Utilization review can eni^ure access to medical record.^ by sup- 
porting a records clerk assigned from utilization review staffing, or 
by having a URC staff member assigned to records and accountable 
to both sections. To some extent, staffing decisions will be related to 
volume of work. If the facility has computerized statistics and data* 
gathering capacity, such services must also be available to utiliza- 
tion review. 
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The objectives of quality assurance programs are broadly con- 
ceived of as two-fold: (1) to assure effective and efficient facility use 
and (2) to continually monitor the appropriateness and adequacy of 
services provided. In other words, quality assurance represents 
that element of program evaluation aimed at monitoring the quality 
of service and ensuring, simultaneously! that it is provided in a timely 
and economic fashion. The organizational structure most ap- 
propriate for carrying out this work is usually the utilization review 
committee. 

Currently, Federal regulations have been promulgated for quality 
assurance tasks under PSRO, Medicare, Medicaid legislation, etc. 
CMHC draft regulations called for: 

• a written plan describing the structural and func- 
tional aspects of the quality assurance program; 

• the delegation of responsibility for quality 
assurance activity to a committee established either 
for that unique function (a utilization review com- 
mittee) or for some other function and able to over- 
see the review systems; 
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• a review of admissions, duration of stay, and profes- 
sional services furnished to assess the need for the 
services and to promote the most efficient use of 
available services and facilities; 

• the conduct of clinical care evaluation studies which 
focus on selected problem areas and review any 
aspect of care furnished that can result in recom- 
mendations beneficial to the patient, the institution, 
or the community. 

The ideal utilization review committee, with at least a full-time 
head and some administrative assistance, would have direct access 
to a medical records and statistics section and liaison either for- 
mally to a patient ombudsman or informally to consumers in order 
to monitor the quality of care and issues of patient rights and dig- 
nity. The utilization review committee would be multidisciplinary 
with participants from the various subunits of the organization. 

Figure 44 outlines the development of a quality assessment plan. 
It emphasizes the tasks which the utilization review committee 
must accomplish. When other standing committees concerned with 
evaluating aspects of patient care, such as admissions, medical 
records, and medical audit committees already exist, the utilization 
review function may be assigned to one or more of them. However, 
if possible, a specific organizational entity should have responsibil- 
ity for institutional utilization review activities. If a particular 
center is too small to properly conduct utilization review, assistance 
can be requested from an outside source. CMHCs serving the same 
general region may benefit from combining utilization review ac- 
tivities for several agencies. A community-based utilization review 
plan offers special advantages by promoting uniformly high stan- 
dards of care for institutions within a particular area, identifying 
needed community health services, and assuring that the health 
resources of the community are maximally useful to the population. 
Community-based utilization review plans also stimulate 'Inter- 
institutional relationships" and exchange of information, benefit- 
ting the individual patient and the community. 



MEMBERSHIP 

Committee memberships should reflect the entire scope of those 
engaged in practice within an institution. As a general rule, all 
disciplines primarily involved in patient care merit consideration 
for membership. In a smaller center, representation might be struc- 
tured by discipline. In committees serving centers organized along 
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the unit system, or serving several centers, all major facilities, ser- 
vices, and affiliates should certainly be represented. In large 
centers, it might be advisable to establish separate subcommittees 
for each major program area. 

Since many issues raised during the review will be related to ad- 
ministrative policy, the facility administrator or designated sur 
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I Indicate the tasks and functions that will be included as part of the quality 
assessment effort, e.g., concurrent review, profile analysis, clinical care 
evaluation studies, the preparation and dissemination of reports, etc. 

II. Describe the organization of the quality assessment effort Including: 

A. committee and subcommittee structure and composition (almost always a 
utilization review committee) 

B. the relationship of committee structure to the tasks and functions out- 
lined in I. 

C. the method of selecting committee members 

D. the term of a member's appointment 

E. the method of selecting a committee chairman, the term of the chairman's 
appointment, and the responsibilities Inherent In the role 

F the relationship of the commlttee(s) to other organizational elements 
within the center, e.g., administration, medical records, program evalua- 
tion, etc. 

G. the frequency of meetings 

H. the type of records that will be kept. 

III. Describe the quality assessment process including: 

A. the authority of the commlttee(s) 

B. procedures for admission certification and continued stay review 

a methods for case selection related to both concurrent and retrospective 
quality assurance review on a case-by-case basis 

D, methods for topic selection In relation to CCE studies 

E, methods for the generation of profiles 

F, the approach to developing and/or revising norms, criteria, and standards. 

IV. Indicate the relationship of the quality assessment effort to claims review. 

V Specify the method for transmitting review findings to administrative and 
clinical staff, the governing body, and continuing education programs. 

VI. Describe followup procedures for monitoring the status of committee recom- 
mendations. 
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rogate should serve as a member or member ex-officio. Staff respon- 
sible for recordkeeping and data processing should also sit with the 
committee on a regular or ex-officio status. When specific studies 
are commissioned by the committee, by-laws should allow for the 
temporary appointment of staff who have special competence in the 
areas being studied. In order to provide continuity, a member's 
term of appointment should probably be for more than one year, 
with only a portion of membership changing each year. Membership 
should not be determined solely on the basis of authority or ex- 
perience, and representation should be open to staff at all levels (i.e., 
director of outpatient service, staff nurse, community health 
worker, chief of social work, etc.). 

The selection of a chairperson should reflect the importance 
ascribed the task, resolving the question of clinician or nonclinician 
on the basis of the center's by-laws, the task of the chairperson, and 
the institution's history of interdisciplinary working relationships. 

Meetings of the committee as a whole should occur at least once a 
month and more frequently when deemed necessary. While 
assignments may be given to subcommittees or individual commit- 
tee members, final responsibility for overseeing the review function 
must rest with the committee as a whole. 

FUNCTIONS OP THE COMMITTEE 

The specific functions of the committee are identified in figure 46. 
The committee has weighty responsibilities for developing policy 
and procedures in relation to the quality assurance process and for 
explicating its relationship to third-party claims administration. It 
must, therefore, arrange for admission certification, monitor each 
case of extended duration, and oversee the retrospective and con- 
current review activities of the organization. 

CRITERIA AND CRITERIA DEVELOPMENT 

To expedite the review process, the formulation and use of pre- 
established criteria are strongly advised. Such criteria are not in- 
tended to provide rigid and inflexible codes of conduct. They do not 
represent a "cook book" of infallible, inedible recipes. Rather, they 
function primarily as screening devices. Screening is defined as the 
process by which criteria, norms, or standards are used to examine 
large numbers of cases in order to select a limited number for more 
substantive review. Criteria have already been established for 
screening on issues such as the need for treatment, the need for ser- 
vices received, the need for continued treatment, and the adequacy 
of care. 
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An Outline for an Annual Report Describing the Activities 
of a Utilization Review Committee 

L Concurrent Review: 

A. Admission Certification 

1. number of cases reviewed 

2. number of approvals/disapprovals 

a. of the disapprovals, number of cases approved/disapproved by clini- 
cian reviewer. 

3. narrative as required for explication 

B. Continued Stay Review (CSR) 

1. number of cases reviewed 

2. number of approvals/disapprovals 

a. of the disapprovals, number approved/disapproved by clinician 
review 

3. narrative description as required for explication 
11. Profile Analysis: 

A. Summary of activity including routine and special profiles developed 

B. identification of follow-up activities stemming from profile analyses 
ill. Clinical Care Evaluation Studies (CCE): 

A. Summary of ail CCE studies undertaken including results 
iV. Action taken based upon the activities outlined in 1, 11, and ill as related to: 

A. Individual clinicians 

B. Service units 

C. Service programs 

D. institutional policy and procedure 

E. Continuing education 



While screening can be accomplished by nonclinicians, sufficient 
latitude should be provided to^he review coordinator to interact 
with clinical personnel and clinician reviewers prior to final deci- 
sions. Final decisions related to the care of an individual patient, 
however, must be made by a clinician reviewer or peer. Such peer 
review is mandatory in any instance where variance from pre- 
established criteria could (1) preclude the continued receipt of ser- 
vices or (2) be associated with recommendations to change the level 
of care provided. 
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In addition, all persons conducting individual case review should 
be encouraged to seek additional information from sources other 
than the record or the abstract or the administrative summary 
forms that exist. The committee, therefore, should develop a 
general policy as to those conditions under which additional infor- 
mation should be solicited and the manner in which it should be ob- 
tained. These policies must rigorously protect the confidentiality of 
both patient and clinician. 

THE CA$B REVIEW PROCESS 

To expedite review of individual cases, a three-level process is 
suggested. The first level involves examining charts of all patients 
admitted to treatment to establish the completeness of the informa- 
tion contained in the chart. This can be accomplished by personnel 
in the record room and is a legitimate medical records department 
function. Charts which do not meet minimal standards of com- 
pleteness should be returned to the attending clinician. Second-level 
review considers whether or not the treatment is appropriate ac* 
cording to screening criteria established by the institution. These 
criteria can address such questions as: What circumstances justify 
hospitalization? Within what time frame should psychotropic 
medication regimens be reviewed? What symptom constellations 
merit a neurological examination? 

Judgments of this nature can be fully operationalized and em- 
bodied in a standard case abstract. In this manner, simple yes/no 
discriminations can be made. If the second-level reviewer finds any 
deviations, then those charts are given a third-level or clinical 
review under the supervision of the committee. In this review, a 
clinician examines the chart, and may, using established guidelines, 
seek other information in order to determine whether the specific 
treatment being questioned is inappropriate or appropriate but 
unusual, or whether the criteria themselves require further refin- 
ing. Such peer review is mandatory whenever a variance from 
criteria would preclude continued treatment. 
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CASE SELECTIOH METHODS 

A criteria-oriented approach is useful in organizing information 
for clinical care evaluation studies. In performing such studies, ma- 
jor issues are related to selection of study topics. Four basic 
mechanisms have been suggested, and it may be useful for an in- 
stitution to develop evaluation studies utilizing all four methods in 
order to maximize the probability of identifying instances of inap- 
propriate care. These methods include: 

IGO 
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1, Random Selection. Cases are chosen in a random 
method which will, over time, guarantee that some 
cases from each unit and each clinician are re- 
viewed, 

2, Selection on the Basis of Problem Type or Service 
Unit At times, a need may arise to review care in a 
relationship to a problem of identified institutional 
concern, or to monitor care in a unit in which orga- 
nizational problems may be predicted to interfere 
with patient care. A URC may elect to focus on pa- 
tients on long-term phenothiazine use to explore 
issues in regard to prescription and side effects. It 
may emphasize a current problem area, such as in- 
cease in adolescents signing out against medical ad- 
vice. The cases selected for review would all reflect 
the problem or the unit to be studied. 

3. Selection on the Basis of an Exception to Established 
Practice, Here all cases which explicitly deviate 
from established clinical criteria would be reviewed. 
For instance, a particular facility may have estab- 
lished a criterion that all patients with a diagnosis 
of schizophrenia should receive phenothiazines. The 
Utilization Review Committee could then request 
from treatment units or clinicians a list of schizo- 
phrenic patients not receiving the phenothiazines. 
These cases could then be subject to more detailed 
review. Drug dosage ranges might be established, 
and prescriptions exceeding or less than recom- 
mended dosage might be routinely subject to 
review. 

4. Selection on the Basis of Pattern Analysis. In this in- 
stance charts are selected which deviate from sta- 
tistical norms established through pattern analy- 
sis. Such selection is facilitated by computerized 
records systems. For instance, cases could be 
selected in which the pattern of care such as dura- 
tion of stay, or type of treatment, deviates in either 
direction from the norm, for a specific patient in a 
given diagnostic category receiving treatment 
upon a given service. The computer program which 
automatically selects cases can report a series of 
such cases on a regular basis to the Utilization 
Review Committee. 
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RECORDS AND REPORTS 

The committee must maintain adequate records of its activities. 
Summaries can be developed from data reported by members, from 
the comments and critiques of case reviewers, and from results of 
clinical care evaluation studies. The summaries of each discrete ac- 
tivity may be incorporated in the committee's minutes. All records 
of the committee, including the review forms/abstract/reviewer's 
comments, however, must be regarded as confidential and not filed 
with the patient's record of note. 

Questions of confidentiality demand special attention. The quality 
assurance process is oriented toward improving care, and all in- 
terventions based upon the work and findings of quality assurance 
programs must rigorously adhere to established procedures with 
great concern for the rights of patients and clinicians lest the entire 
program be seen as repressive, dentructive of good care and in- 
terpersonal relationships, and an impediment to clinical work. To 
the extent that URC actitivies are viewed as elements of an institu- 
tion's management structure, and divorced from medical and/or pro- 
fessional staff self-regulation, the protection of these records may 
be in jeopardy. 

The utilization review committee is responsible not only for 
reviewing the status of care but also for commenting upon it and 
recommending possible avenues of correction. To be effective, staff 
members and administrative personnel must thoroughly under- 
stand the scope and function of the review process. Reports should 
be made regularly to the center's executive committee, and relevant 
information should be made available to the entire staff, the ad- 
ministrator, and the governing body. Results of special studies, as 
well as recommendations, should be thoroughly discussed and used 
as the basis for a continuing education program for the entire staff. 
When care provided by an individual is seen as inadequate, the clini- 
cian should be approached directly by a peer reviewer and a pro- 
gram of corrective action identified. Such activities must be kept 
highly confidential. If corrective action is not successful, formal 
channels must be identified for the orderly conduct of requisite 
disciplinary action. Since many clinicians may view this entire proc- 
ess as a means of coming between the patient and clinician, the work 
of a utilization review committee must be generally acceptable by 
clinicians before any disciplinary action is even contemplated. 
Without extensive involvement of clinicians in the review process, 
the committee will have little institutional impact. The quality 
assurance program must demonstrate its ability to enhance patient 
care. 
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An annual report should summarize all recommendations made 
and actions taken, including educational, administrative, and pro- 
grammatic concerns related to either the efficiency of facility use or 
the quality of care provided. We include as an appendix to this 
chapter sample committee reports which may provide a useful 
model for an annual report format. 

The findings generated from utilization and peer review should 
also be routinely employed to assess the adequacy of the screening 
mechanisms and criteria in order to identify areas requiring 
modification. The review process and the activity of the committee 
should always reflect the most current statement of appropriate 
patterns of treatment. 

A utilization review structure and an effective quality assurance 
plan provide information about the functioning of the organization 
to the organization and its members. Such information is inherently 
valuable to management as it allows for early corrective interven- 
tions into problem areas and identifies possible needs to reallocate 
or generate additional institutional resources. If the review process 
only limits activities and does not help the institution generate 
resources in order to address new problem areas, the process will 
become rapidly bureaucratized and essentially ineffectual. 

To illustrate the development of the utilization review process, 
there is presented here a case example that is a composite of the ex- 
perience of mental health professionals with responsibility for qual- 
ity assurance programs in different mental health settings. The 
description of the Utilization Review Committee in a hypothetical 
setting provides a perspective into the complexity of the UR proc- 
ess. Through annual reports included in the case study, the reader 
can follow the evolution of the UR system over a period of three 
years. Though brief, these reports provide a glimpoe into the pro- 
gression of steps in the development of the system. 
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EASTERN MENTAL HEALTH 
CENTER (EMHC) 

UTILIZATION REVIEW 
COMMITTEE: 

Summary of Activities 
1 972-1 975* 






*This case is excerpted from "Utilization Review in Mental 
Health: A Case Example" that originally appeared in Evaluating 
Community Mental Health Services: Principles and Practice, 
edited by 1. Davldoff. M. Guttentag. and J. Offutt. DHEW 
Publication No. (ADM) 77-465, 1977. 
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EASTERN MENTAL HEALTH 
CENTER (EMHC) 

UTILIZATION REVIEW 
COMMITTEE: Summary 
of Activities 1972-1975* 



The Process Begins 

At the EMHC, development of the utilization review process began with 
the establishment of the Utilization Review Work Group to advise on and 
collaborate in the development of the Utilization Review Plan. Though major 
responsibility for implementing the plan was assigned to theCMHC's Utiliza- 
tion Review Committee, the Work Group continued to play an Important role 
In the UR process. During the first year of ihe Utilization Review Com- 
mittee's operation, a proposed UR plan was presented by the committee to 
the director and Executive Committee of the EMHC. Final approval was, 
however, delayed until the URC's second year of operation. 

As a first step, the Work Group members outlined the following princi- 
ples which at a minimum they considered essential to a ''workable" utiliza- 
tion review model. 

1. The UR plan should demonstrate the utility and interrelationships 
of component parts of the UR system. 

2. Explicit standards for adequacy of care should be developed that 
reflect on assessment of factors such as diagnosis (schizophrenia), 
symptom (suicide), developmental period (adolescence), and 
institutional process (intake). 

3. Criteria for care should be defined. 

4. Mechanisms should be constructed for case selections for utiliza- 
tion review based on norms developed by professional panels and 
upon detailed analysis of patterns of care. 

5. Components of the review mechanisrii should be implemented as 
soon as practical. 



♦The fhst major research project on developing a methodology for utilization review 
of mental health services was Initiated by an interdisciplinary team at Yale University In 
1969. The model system of patient care review Is described In Rcldcl, Donald C; 
TIschier. Gary L; and Myers. Jerome K. eds.. Patfent Care Evaluation in Mental Health 
Progr<;ms. Cambridge, Mass.; Ballfnger Publishing Company, 1974. 



ERLC 



156 

165 



Establishing a UR Committee 



157 



6. Problems involved in setting up and implementing the UR model 
should be documented. 

7. Feedbacit mechanisms should be integrated into the system so that 
findings can influence policy, administration, and services. 

UTILIZATION REVIEW COMMITTEE PLAN 

Upon the recomrtiendation of the Clinical Chiefs' Committee (CCC), the 
URC was authorized in June, 1972, by the director and the Executive Com- 
mittee of EMHC as a subcommittee of the Clinical Chiefs' Committee and 
accountable to it for the performance of its taslcs. 

It was specified that the Utilization Review Plan to be developed by the 
URC required approval by the Clinical Chiefs' Committee of EMHC prior to 
Its adoption. 

In accordance with the t&sks and procedures outlined in the URC plan, 
the URC was assigned the authority to review the chart of any patient of 
EMHC and discuss the management of any case with appropriate staff, inter- 
views with patients or former patients would normally be preceded by dis- 
cussions with clinicians or former clinicians, and principles of confidentiality 
would be respected. 

The chairman of URC would be a member of the Clinical Chiefs' Com- 
mittee, representing the views of URC based on URC experience with re- 
viewed issues. Through regular participation on CCC, he would be informed 
regarding current patient care issues raised in committee and share informa- 
tion regarding URC activities with CCC. 

In its first phase of development, URC would cooperate with the UR 
Worl< Group, by providing it with a copy of the minutes of URC monthly 
meetings and of special reports. 

Specific URC procedures and functions were approved as described 

below. 

URC Functions 

The Utilization Review Committee of the Eastern Mental Health Center 
has the task of developing a utilization review plan to monitor the level of 
care provided to patients. The committee's functions are as follows: 

1. Supervising all utilization review activities as related to individual 
patient care and appropriate use of EMHC resources. 

2. Defining extended duration, evaluating over- and under-use of 
treatment, and routinely reviewing cases of extended duration. 

3. Collaborating with the UR VJork Group which by an examination 
of charts provides monthly reports to the URC summarizing the 
results of individual case review. 

4. Reviewing, analyzing and interpreting the weekly, monthly, quar- 
ts )y, and annual statistics prepared by the Statistical and Record 
Center, and formulating policy recommendations based on this 
analysis. 
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5. Undertaking special studies that relate to the utilization of services^ 
their relevance to community needs and the systems of semce 
delivery. 

6. Devising the means by which the quality of care may be appraised 
from the perspective of the patient-consumer. 

7. Establishing other ways to monitor the level of patient care in the 
EMHC in addition to individual chart review as performed by the 
UR WorkGroup. 

8. Developing other activities related to studying utilization in the 
EMHC and possible improvement in patient care. 

S. Reporting URC findings to the Clinical Chiefs' Committee, particu- 
larly deviations from standards of appropriate care and URC*s 
recommendations for procedural changes that affect patient care. 

10, Translating the findings of the URC into recommendations for 
staff training. 

1 1 . Providing feedback to appropriate persons, including the sharing of 
material, reports and special studies, thereby conforming to URC's 
purpose of providing an objective and educational peer review 
mechanism. 

The general functions of URC are defined in terms of permanent sub- 
committees on Patient Care Review and Consumer Opinion, and provide for 
Program Evaluation Task Forces. While subcommittee structure is subject to 
change, it is expected that similar methodological approaches will be used in 
the future, regardless of structure. 

Findings and recommendations are presented to the full URC for its 
approval or disapproval and approved URC recommendations are sub- 
sequently presented to the Clinical Chiefs' Committee for its approval and 
implementation or its disapproval. 

URC Procedures 

1 . Individual patient care review tasks include: 

A. Collaborative work with the Work Group toward Improving the 
current system of review and developing alternative review 
approaches. Work Group Monthly Reports identify cases that 
merit further review in accordance with Work Group standards. 
Such standards are also open to revision as a result of URC 
review. 

B. Development and testing of mechanisms to report findings to 
clinicians, supervisors and unit chiefs regarding the quality of 
patient care and its impact on the ongoing program of the 
EMHC. 

C. Periodic evaluation of the efforts of URC, with a review of its 
results, issues and methodologies. 

D. Review of the clinical management of patients: 

(1 ) Selected from Work Group screening 

(2) From selected clinical services 

— -^3)>^SekctBd_.biL.s>miptpr^ diagnosis, age, ethnic characteristics, 

etc. 
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(4) Who died from any cause 

(5) In the defined category of extended duration of treatment 

(6) Selected from the defined category of under-use of treat- 
ment 

(7) Selected on the issue of appropriateness of: 

(a) Admission 

(b) Treatment plan 

(c) Continuity of care 

(d) Disi harge plan 

(e) Supportive services (interna^ and external) 

E. Procedures that enable reviev^ers to become familiar with the 
management of the case through review of tt^e chart and Work 
Group consultant's commsnts, and discussion ai? appropriate 
with the consultant, clinician, supervisor, unit chief and patient. 

F. Periodic review of previously studied problems in order to assess 
what effect, it any, previous recommendations have had on 
quality of programs. 

2. Work Group staff will focus on cases that contain questionable areas 
primarily related to recording. 

3. Patient Care Review Subcommittee's) meets twice a month and 
small working groups maiy meet more frequently. Reviewers, work- 
ing singly or in pairs, present findings to the full subcommittee and 
subsequently to the full URC. After approval, they .-»re presented to 
the Clinical Chiefs* Committee for its approval and implementation 
or its disapproval. 

4. Through Program Evaluation Task Forces, URC will conduct studies 
of the quality of patient care. These studies will: 

A. Analyze and interpret statistical reports regarding patient care 
(weekly, monthly, quarterly, annually). 

B. Request special statistical reports as needed, 

C. Study and interpret specific problems in EMHC referred by the 
Clinical Chiefs* Committee, division heads, et al. 

D. Study documents of service units and departments when rele- 
vant to committee tasks. 

E. Participate in defining extended and under-use of treatment. 

F. Refer selected areas of study to Patient Care Review Sub- 
committee(s) for individual case review. 

G. Study patterns of preventative as well as direct services. 

H. Periodically review previously studied problems in order to 
assess what, effect, if any, previous recommendations have had 
on quality of programs. 

5. Program Evaluation Task Horces wiii present their findings to the 
full URC for its approval and subsequently to the Clinical Chiefs' 
Committee for its approval and implementation or its disapproval. 

6. While Patient Care Review Subcommittee(s) assesses the quality of 
care given by clinicians, URC also seeks through a Consumer Opin- 
ion Subcommittee lo learn how patients and former patients regard 
the care provided from their perception of needs, wants and expec- 
tations. 
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A. Data may be offered by or actively solicited from consumers, 
through written means or verbal interviews. 

B. Consumer feedback may be sought from a random population 
of applicants for services or a specific population defined by 
variables such as demography, diagnosis, treatment plan or out- 
come. Methods would vary according to focus. Studies of 
known or suspected problems in the delivery system may also 
be undertaken. 

C Consumer Opinion Subcommittee meets at least monthly and 
presents findings and recommendations to the full URC for 
approval and subsequently to Clinical Chiefs' Committee for its 
approval and implementation or its disapproval. 

URC Menaber Responsibilities 

Each URC member has a responsibility to devote the time and effort 
necessary for URC to fulfill the committee's tasks. Recognition of each mem- 
ber's contribution of time and effort given to URC requires administrative 
support within the context of the members' primary and total responsibilities 
as an EMHC staff member. It is expected that each member accepting 
appointment offers individual expertise as well as representation from his or 
her primary service unit. 

The chairman is the one person who represents URC to the community. 
He carries administrative responsibilities for the functioning of URC and Is 
the communicative link to URC subcommittees, its task forces, and its mem- 
bers. 

Specific functions of the chairman include: 

1 . Chairing monthly URC meetings, planning agenda. 

2. Chairing meeting of subcommittee heads for the purpose of coordi- 
nating various URC activities. 

3. Participating ex officio in URC subcommittee meetings with particu- 
lar responsibility of helping avoid duplication of effort among other 
committees of URC and of the EMHC. 

4. Handling all incoming and outgoing URC communications. 

5. Presenting special reports, findings, and recommendations to Clinical 
Chiefs' Committee and to other appropriate persons. 

6. Supervising secretarial and other supportive services related to URC. 

7. Maintaining liaison with the UR Work Group. 

8. Arranging for specialists to assist URC members in their tasks as 
needed. 

9. Submitting an Annual Utilization Review Report which includes the 
following information: 

A. A summary of the past year's utilization review activities includ- 
ing a discussion of both special studies and cases of extended 
duration and under-use of treatment. 

B. Plans for conducting special studies during the next year. 
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Composition of Membership 

The romposition of the URC should reflect the Importance of its work. 
Th« chairman of the committee should be a highly experienced clinician of 
any discipline who understands the service delivery system of EMHC and has 
an ability to worl< effectively with a wide range of staff representing various 
disciplines as well as with consumers and other agency personnel. 

Other members of the committee should be chosen to represent every 
service offered to patients at the EMHC but not necessarily in terms of 
administrative units. EMHC staff who are not official members of URC may 
serve as members of subcommittees and task forces, but not as chairpersons. 

Appointment of Members 

initial members of the URC will be appointed by the director of EMHC 
for a term of one year, commencing July 1, 1972, in accordance with pro- 
gram and disciplinary representation described previously. For the purpose of 
continuity, there Is no provision for alternate representation In the event of 
Illness, vacation, etc., of members. 

Members are nominated by chiefs of programs and appointed by the 
director of EMHC in consultation with the chairman of the Clinical Chiefs' 
Committee and the chairman of URC 

Terms of appointment will normally be for three y.^ars with provision 
for approximately one-third of the members In rotation, in order to achieve 
this plan, on July 1, 1973, one-third of the members will be appointed to a 
one-year term, one-third to a two-year and one-third to a three-year term. By 
July 1, 1974, all new appointees will be appointed to terms of three years. 

The chairman will be appointed by the director of EMHC in consultation 
with the chairman of the Clinical Chiefs' Committee for a term of one yec.r 
with eligibility for reappointment. 

The representative of the Psychiatric Residents' Association will serve a 
term of six months (modular placement) or one year (track placement). 
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EASTERN MENTAL HEALTH CENTER 

ANNUAL REPORT 1972 1973 
UTILIZATION REVIEW COMMITTEE 



The Utilization Review Committee of (Eastern Mental Health Center 
[EMHC]) was authorized by the director and Executive Committee of EMHC 
in April 1972, upon recommendation of the Clinical Chiefs' Committee. We 
are fortunate that the UR Work Group, with consultative assistance from a 
range of mental health professionals, e.g., clinicians, social scientists, epi- 
demiologists, and administrators, had already begun a study of the problems 
of performing patient care evaluation. 

As part of its effort, the Work Group developed a set of criteria for a 
number of aspects of patient care, from evaluation through treatment. These 
were applied to assessing the quality of care at the EMHC through its utiliza- 
tion review mechanism. During 1971 the UR Work Group and its consultants 
developed an individual Chart Review Checklist. The interest, experience and 
work of this group were, without question, helpful in establishing a Utiliza- 
tion Review Committee at EMHC and provided a head start in coming to 
grips with its basic task. The Utilization Review Committee received its 
charge from the director and the organization of the URC was underway. 

The chairman, appointed for a term of one year, was relieved of other 
responsibilities so he would concentrate his primary efforts on URC activities, 
Committee members were appointed with a view toward reflecting the impor- 
tance with which the EMHC viewed this work. The committee included repre- 
sentatives of every kind of service offered our patients and included senior 
clinicians with administrative responsibilities as well as first-line service 
personnel. The composition of.^t 21 -member committee consists, to our 
knowledge, of a greater variety of disciplines, clinical exp^irience and creden- 
tials than exists in most o>.her URCs It is truly a reflection of peer review. 
Three subcommittees were formed at the first monthly meeting lield in 
August: 

1 . Patient Care Review ~ to review individual patient care 

2. Statistical Analysis and Review - to review and interpret statistical 
dat^ 

3. Consumer Opinion - to learn of the nature of treatment experience 
from the perspective of the patient or former patient. 

^ I . 
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Subcommittees generally met twice a month and reported to the full 
URC whose approval was required before presenting findings and recommen- 
dations to the Clinical Chiefs* Committee, of which we were a subcommittee. 
Immediate tasks were to formulate written statements of tasks and proce- 
dures that could be sanctioned by CCC. 

A major accomplishment during the nine months of its existence has 
been to establish a sense of working together among members of the commit- 
tee. An egalitarian quality of decision-making has been achieved, and the 
members feel a sense of gratification from their efforts. 

An educational focus, rather than punitive, has been felt by clinicians 
who have interacted with members of URC. A low-keyed approach with 
accompanying limited publicity in keeping with experimental methodologies 
employed by the committee, has produced an initial receptivity to the work 
of URC by clinicians, unit chiefs, and administrators. 

By pairing reviewers of different disciplines and varying clinical experi- 
ence, the reviewers felt an enrichment in their work. 

Early questions within URC regarding its authority and integrity have 
been largely allayed through discussions with the chairman of CCC, and 
through appointment of the URC chairman to the CCC, The latter step has 
enabled week-to-week sharing of information regarding overall institutional 
clinical issues and the work of URC, 

Structural questions persist in the committees' efforts to devise the best 
method to accomplish our tasks, and a total Utilization Review Plan is yet to 
be presented to CCC for its approval. In the meantime, the subcommittees 
have been testing methods and engaged in activities that we believe Inave had 
or will have a beneficial effect on the quality of patient care at EMHC. 

The Patient Care Subcommittee has completed a review of 36 cases in 
which the issue of Suicide Assessment was studied. Included in this review 
were three cases of completed suicides. The report has been presented to CCC 
where it is being actively considered. This review has provided the sub- 
committee with an initial experience of reviewing charts and written com- 
ments of Work Group consultants, of beginning interactions with clinicians, 
supervisors and unit chiefs. 

There is a suggestion that an active Utilization Review process is having 
a stimulating effect on clinicians and supervisors to complete written docu- 
mentation of their clinical management of patient care. 

The Statistical Analysis and Review Subcommittee would more correctly 
be termed Special Studies since its interest goes beyond statistics. Its major 
work has been and continues to be the definition of expected norms cf dura- 
tion of treatment for the various treatment modalities employed within 
EMHC 

The subcommittee review of the ''no show*' rate of persons scheduled for 
evaluation interviews and the number of scheduled and nonscheduled ap- 
pointments, resulted in recommendations for block-scheduling of a larger 
number of applicants which led to better utilization of clinicians* f»me. 

There continues to be interest in reviewing the status of our Indirect 
services to help us learn what we are or should be emphasizing in terms of 
community needs. 
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The Consumer Opinion Subcommittee defined ''consumer" as a patient 
or ex-patient of EMHCi searched the professional literature to learn of the 
experience of other psychiatric facilities in learning from patients their per- 
ceptions of the treatment, and is now engaged in a limited experiment, inter- 
viewing patients who have given consent to such interaction* 
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ANNUAL REPORT 1973 - 1974 
UTILIZATION REVIEW COMMITTEE 



In its second year of existence, URC has made considerable progress on 
several fronts. This is attributable to the growing ecperience of the members 
working together, the stability and efforts of the committee members, 
increased understanding of the purposes of URC by the EMHC staff and the 
members themselves, and the administrative support evidenced by the leader- 
ship of the institution. The structure of URC was changed somewhat. The full 
committee and Consumer Opinion Subcommittee continue to meet monthly. 
The Patient Care Subcommittee meets every other week, as it did last year. 
The Statistical Analysis and Review Subcommittee, which had devoted much 
of its energy to the development of norms was dissolved, and in its place, task 
forces have been constituted to address specific needs as they arose. Two task 
forces have functioned during the year: 1) Norms and 2) Procedures to 
Review Extended Length of Stay Cases. 

STATUS OF URC ACTIVITIES 

L Patient Care Reviev^ 

A. Suicide Assessment (36 cases, including 3 completed suicides) 

1. Recommended that incident report and written unit review with 
possibility of URC Review, be established as Institution-wide 
procedures in all cases of suicides, serious suicidal gestures and 
deaths, involving EMHC registered inpatients, outpatients and 
recently discharged patients (two weeks). 

Approved by Clinical Chiefs' Committee and adopted by 
Executive Committee. 

2. Recommended that documentation be provided when potential 
for suicide is marked as present on Admission or Mental Status 
Examination forms. 

Approved by Clinical Chiefs' Committee. 

3. Recommended that suicide assessment report be utilized by unit 
chiefs in orientation, preservice and staff development programs 
as well as be available in library, for reference. 

Approved by Clinical Chiefs' Committee, 
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4, Recommended that formulation should be undertalcen of what 
constitutes a lethal supply of medication dispensed at any one 
time. 

Referred by Clinical Chiefs' Committee to Pharmacy Com- 
mittee. 

5, Recommended that periodic assessment of chronic patients' 
clinical status and supports be strengthened. 

Referred by Clinical Chiefs' Committee to Medical Records and 
Information Committee. 
Assessment of Support (1 7 cases) 

1. Recommended that staff orientation emphasize specific topics, 
e.g.i family and collateral involvement in the evaluation process, 
relation of low income to mental health, special resources 
within EMHC and in the greater community. 

Approved by Clinical Chiefs' Committee, referred to training 
component for implementation. 

2. Recommended high risk categories in Work Group's Assessment 
of Support Checklist include people on welfare, low income, 
minorities. 

Approved by Clinical Chiefs' Committee; Checklist modified. 

3. Developed a checklist to assess systematically support structure 
of patients. Of potential training use for trainees and staff, re- 
port and checklist will be available in library for reference. 
Checklist will be further expanded to include additional high 
risk groups. 

Approved by Clinical Chiefs' Committee. 
Charts Adjudged "Adequate" by Work Group review (14 cases). 

Purpose was to test the adequacy of the criteria to discriminate 
adequate and inadequate patient care at the work group level of 



1. The Work Group criteria did discriminate adequate and inade- 
quate care as recorded in the chart. 

2. Recommended that significant medical problems, e.g., low or 
high blood pressure, allergies, drug sensitivities, be noted in 
Transfer/Discharge summaries and noted again (with changes, if 
any) at time of patient's readmission on Supplemental Ad- 
mission Form. 

Approved by Clinical Chiefs' Committee, referred to Medical 
Records and Information Committee for inclusion in its study 
of reorganizing documents included in the chart. Pharmacy 
Committee developed and made Side Effects/Allergic Reactions 
Report available as a teaching aid for clinicians. 

AMA (20 cases being reviewed) 

This review Is currently in process, with no report available at this 

time. 

Special Case Review 

Administration has referred cases for special review. URC is the 



review. 



Results: 
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institution-wide mechanism for such a service, whether the request 
comes from within EMHC or from a source located in the wider 
community. 

II. Consumer Opinion 

A. Recommended that suggestion boxes be strategically placed in serv- 
ice areas to learn of patient satisfaction or dissatisfaction with 
service, 

Rejeaed by Clinical Chiefs' Committee as limited in value. 

B. Recommended that pilot study of discharged patients be undertaken 
to learn consumers' perceptions of the quality of service received. 
Approved by Clinical Chiefs' Committee, study in progress. 

C. Consumer issues handled by Chairman, URC, from 4/1/73 -4/1/74, 
most by personal interviews. 

Types of Issues 



Blllingi Fees 7 

Dissatisfaction with clinical services 5 

Confidentiality 3 

Dissatisfaction v/lth reception 2 

Family seeicing Information 2 

Interagency referrals 2 

Gaining entry to service 1 

Refusal of Blue Cross to approve payment 1 
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III. Task Force 

A. inpatient Referral Patterns 

In the process of reviewing data which led to the recommenda- 
tion of norms for length of stay for the inpatient Units, it was noted 
that, of the patients discharged during a recent 6-month period: 
81% from Unit I were referred to another resource 
41% from Unit II were referred to another resource 
Although it was not possible to conclude definitively what the ex- 
planation for the large difference is, it was noted that the two ward 
populations differ significantly in socio-demographic factors. It is 
speculated that poor patients without established relationships with 
private practitioners or clinics are more likely to be discharged with- 
out referral. 

Further, there is no existing or easily obtained verification that 
the indication of a referral on a discharge form is actually achieved 
i.e., there is no systematic foliowup to establish that continuing care 
is achieved. 

B. Norms 

Last year, norms for extended length of stay for two inpatient 
units v.'ore recommended and approved by the Executive Com- 
mittee: 

~ Short Hospitalization Unit"1 4 days 

- Eastern Mental Health Center Inpatient Unit~30 days 
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Continuing its efforts, norms for the long term Inpatient Unit were 
recommended and approved as follows: 

— Diagnosis of Schizophrenia-165 days 

— Diagnosis of Affective Disorders-120 days 

Norms of 45 days length of stay were recommended, approved and 
are ready for implementation at an appropriate time for the partial 
hospitalization units. 

The following norms have been recommended for consideration 
by CCC and by staff of the units to be implemented at an appropri- 
ate time: 

— Asscssment-5 or more clinical sessions 

— Brief Treatment-13 or more clinical sessions 

— Individual Psychotherapy--62 or more clinical sessions 

— Group Psychotherapy-73 or more clinical sessions 

— Couples/Family Psych otherapy-59 or more clinical sessions 

— Community SupDort-49 or more clinical sessions 
C. Criteria for Necessary Hospitalization 

The work of this task force is still in progress. 
The intent is to have criteria in place ready for implementation 
at a time deemed appropriate by EMHC. 

IV. Other Activities 

A. Review of extended length of stay has been performed by six senior 
physicians, beginning 7/1/74, Thus far, all eleven of the cases subject 
to review were justified, in the judgment of all reviewers. 

B. A total of 31 incidents of suicide attempts and completions have 
been reported from 6/20/73 to the present. 

C Consumer issues handled by Chairman, URC, from 4/9/74 through 
2/26/75, most by persona] interviews: 
Types of Issues 



Fees 9 

Dissatisfaction with services 8 

inter-agency activity 2 

Confidentiaiity 1 

Discrimination 1 

Gaining entry to service 1 
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D. joint followup activity with administration on a Work Group report 
that noted a lack of discharge summaries in charts of clients in the 
Spanish Clinic resulted in a request for staff training sessions in 
charting, which was subsequently provided. 

V, Plans For Next Year 

Structural changes in the committee will be considered by the Patient 
Care Subcommittee. It may meet monthly with provision for task forces to 
meet during other weeks of the month. Depending on the redefinition of its 
charge, Consumer Opinion Subcommittee may reconstitute itself. There Js no 

17/ 
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value to reconsidering the merits of UKC being accountable directly to the 
director or his designate, rather than to the Clinical Chieft* Committee or its 
successor. 

The Utilization Review Plan will need to be updated reflecting changes in 
light of our experience and examining its appropriateness In relation to rules 
and regulations provided by governmental bodies, PSROs et al. URC is 
providing the mechanism for review of extended length of stay and recom- 
mendations of criteria for necessary hospitalization and may eventually par- 
ticipate in the review of justification of admissions. 

Several patient care studies will be in process during the year. Selection 
of studies may be made (but will not be restricte^J .to)' from the following 
Issues: 

A. Patterns of transfers within EMHC, concentrating on: 

1, Reason (s) for transfer 

2. Factors that affect completion or noncompletion of transfer 

B. Characteristics of clients whose multiple use of EMHC is confined 
to triage 

1 , Frequency of use over a two-year period 

2. Characteristics of clients including problem appraisal 

C. Over-utilization of continuing care services 

1 . Justifications 

2. Comparison of patient and clinician characteristics between 
over-and-typical-utillzers of services 

3. Costing of EMHC resources 

D. Patterns of care and utilization within specialized treatment pro- 
grams: 

1 . Drug and Drug Abuse 

2. Alcohol 

3. Depression 

4. Indirect Services 

E. Followup of extended inpatient care retrospective review of possible 
impact of implementing case review of extended length of stay, from 
9/1/75 to present (10 cases) 

F. Review of reported suicide attempts and completions, from 6/20/73 
to present (31 cases) 

G. Study of Work Group reviewed cases presenting institution-wide 
issues or issues supporting URC-clinician interaction 

H. Study of crisis services provided in General Hospital Emergency 
Room (ER) for EMHC patients and how the referral and followup 
process works between ER and EMHC. 

I. Examination of the process of determining diagnosis and how a 
diagnosis is used at EMHC 

J . Review of adequacy of recording and appropriateness of medications 

in ongoing patient care 
K. Study of levels of care provided by different professional groups, 

i.e., psychiatrists, psychologists, nurses, social workers, psychiatric 

aids, chaplains, etc. 
L. Assessment of patient satisfaction with services at EMHC 
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Study of patients who are out of the center from Triage and/or 
Evaluation, to see why the particular referrals were made (this is 
not to indicate that the referrals were not appropriate) 
In general, the work of the Work Group has continued to be a great 
source of help to URC It is hoped that URC will make greater use of the 
wealth of clinical information about patient care. Burgeoning record-keeping 
demands have kept step with logging and monitoring of review of length of 
stay in addition to the minute-taking of committee and task force meetings. 
The six senior psychiatrists who have reviewed extended length of care cases 
have given freely of their time and expertise and performed their work 
promptly. 
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ANNUAL REPORT 1974- 1975 



UTILIZATION REVIEW COMMITTEE 



During its third year of activity, URC has implemented plans developed 
during the previous year and initiated and completed studies of patient care 
issues. The continuity of its interest and work has been maintained due to the 
dedication of its membership. 

Five members resigned during the year and five had joined the committee 
in July, representing a significant turnover in membership. Changing service 
assignments that conflict with URC meetings had its impact on reduced 
attendance at the monthly meetin?,s. 

The Consumer Opinion Subcommittee has dissolved pending a CCC 
redefinition of a charge co URC regarding the consumer's perception of treat- 
ment. The Patient Care Subcommittee has studied patient care issues de- 
scribed below and various tasl< forces have contributed valuable reports. 



I. Patient Care Subcommittee 

A. Discharges Against Medical Advice 

1. Recommended that guidelines be developed to assist clinician 
in the appropriate use of this category. 
Awaiting Action of Clinical Chiefs' Committee 

B. Treatment Plan 

1. Recommended that individual treatment plans be recorded for 
patients in group treatment. 

2. Recommended that charts of patients in long term treatment 
contain continuing documentation of treatment plan and its 
implementation within 6 months' intervals. 

3. Recommended that for those patients whose onlv^ treatment is 
medication, this be clearly stated. 

4. Recommended that an ongoing educational pro.; n for out- 
patient services be focused on formulation of treaf.ent plan 
and its relationship to the course of treatment. 

Tabled by Clinical Chiefs' Committee in favor of considering 
treatment plan as part of a continuum, from presenting prob- 
lems through outcome ot treatment. 



STATUS OF URC ACTIVITIES 
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1 1 Consumer Opinion Subcommittee 

A. Conducted pilot study of recently discharged patients. A potential 
list of 1 12 patients was reduced to 28. Of these, 9 were interviewed. 
The interviews were regarded as valuable but disproportionate to the 
time and effort used in this process. Direct interviews along the lines 
of the pilot study may be instituted when staff resources are made 
available. 

B. A questionnaire devised to solicit patients' views of their experience 
at EMHC was submitted to CCC for approval. 

Rejected by CCC. 

C. Subcommittee requested CCC to redefine the charge to URC rela- 
tive to con&umer opinion and has dissolved as an ongoing subcom- 
mittee of URC 

III. Task Force on Norms 

Normative length of stay has been defined as the number of days beyond 
which a case should be subject to review. A stay beyond the norm in no way 
implies the inappropriateness of the longer stay. A norm for length of stay 
should not be interpreted as defining a maximum length of stay. 

A. Norms for extended length of stay recommended and approved by 
Executive Committee: 

- Short General Hospital Psychiatric Unit - 14 days 

- Eastern Mental Health Center Inpatient Unit - 30 aays 
Norms recommended and in final stage of recommendation: 

- Research Inpatient Unit 

-schizophrenic diagnosis group 
.itfjctive disorders group 

- Partial iospitalization Unit 

- Day Hospital Unit 

B. Analysis of the efficacy of the 45<lay or four interview maximum 
for the Assessment and Acute Unit instituted 7/1/73 was undertaken 
through study of computer-stored data, providing initial experience 
for Program Evaluation Task Force in comparing statistical data with 
existing policy and providing such feedback to unit chief. 

IV. Task Force on Procedures for Review of Extended Length 
of Care Cases 

Focusing on extended length of care for inpatients, URC review is pred- 
icated on the expectation that each unit will conduct its own audit and 
review of each case anticipated to extend beyond the norm. 

An Extended Care Review Form will be sent by URC to unit prior to 
norm date, unless the patient has already been discharged. The URC review 
will be completed within 7 days beyond the norm date, including in its review 
a study of the completed form, any additional summary that the unit pro- 
vides, a review of the chart and if further clarification is needed, discussion 
with unit chief, team leader, and/or other appropriate clinicians. While it is 
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within its purview to interview patients, it is anticipated that this will be done 
only for compelling reasons and after discussion with the unit chief. Finally, 
the reviewer will note approval or disapproval of the extended length of stay. 

It is the intent of EMHC to carry out its review in accordance with 
existing regulations deriving from legislation of Medicare and other related 
Federal mandates. 

V. URCAsAWhole 

Legitimizing the work of URC was the approval of a Utilization Review 
Plan by the Clinical Chiefs* Committee and Executive Committee in the fall 
of 1973. The structural arrangement, whereby URC functions as a sub- 
committee of Clinical Chiefs' Committee, appears to be viable. No major 
structural changes are anticipated. 

The Patient Care Subcommittee will be involved in reviews of types of 
extended care cases, in addition to its ongoing work. 

The Consumer Opinion Subcommittee continues to search for an optimal 
way of learning from consumers how they regard our services, with a regard 
for the most efficient u<ie of staff time and effort to engage in this activity. A 
way will need to be found, in order to recognize the importance of translating 
consumer concerns into priorities and quality of our services. 

Spin-offs from URC-raised hsues have occurred. For example. Pharmacy 
Committee's Side Effects/Allergic Reaction Report was stimulated by the 
URC Study of Adequate Charts. It is hoped that additional spin-offs will 
occur in the future. 

The Norms Task Force, conceived as an ad hoc operation, may be con- 
sidered to be an ad infinitum exercise, what with our goal of recommending 
norms for both extended and too brief lengths of stay for outpatient as well 
as inpatient units. Further, unit norms will be reviewed in light of experience 
and possibly by selected characteristics, e.g., diagnosis, age, race, etc. Review 
of indirect services, while of interest to URC, was held in abeyance this year, 
awaiting the results of the Eastern Mental Health Center's efforts to articu- 
late Identifiable aspects of those services that lend themselves to a UR proc- 
ess. 

URC provides a review mechanism for the continuing, orderly appraisal 
of the quality of patient care and use of resources. Its je to EMHC is in- 
creasing and may benefit other facilities as we learn inc'■•^^ingly how to look 
at what we are doing, and in the process, better serve our ciients and patients. 
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As one moves from reglor^ to region, from one type of mental 
health facility to aaolm from otate to State, differenceo in prac- 
tice and in the resources and capc^bilitiei available for the perfor- 
mance of quality assurance activities become apparent. Despite this, 
our intent in ^his volume has been to present a way of thinking 
abou*^ quality assurance »n mental health settings and identify an ap- 
proach to the technical and nontechnical tasks involved in this 
endeavor 

We co-^.ceive of quality assurance as one part of program evalua- 
tion. Quality assurance can enhance clinical programming and the 
delivery of service to individuals. It can help the organization 
monitor practice and accumulate data that demonstrate the ex- 
cellence of institutional programs (or at least show that clinical pro- 
grams serve those who are supposed to be served, in ways that 
meet current standards). Quality assurance includes all those ac- 
tivities aimed at assessing or improving the quality of care — utiliza- 
tion review^ peer review, certification of staff credentials for prac- 
tice, promulgation of structural regulations to assure adequate proc- 
esses of care, and even outcome studies. Utilization review refers to 
those activities which increase or control the efficiency of the 
utilization of resources and generally include concurrent and 
retrospective review. Peer review simply means review activities 
conducted by discipline peers. 

Among the technical tasks identified in this text are the develop- 
ment of criteria and the establishment of administrative structures 
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and procedures to conduct quality assurance activities. The impor- 
tance of an adequate record and the implementation of a manage- 
ment information system as basic to the capacity to accomplish this 
work have been emphasized. The computer may assist in such ac- 
tivities, but more important is the ability to identify relevant ques- 
tions and design information systems that allow for relatively easy 
collection and retrieval of such information. Further, since the 
nature of the criteria determines how adequate care will be defined, 
the importance of criteria development has been highlighted. 
Whether one adapts already developed criteria or develops them 
locally, organizational members must work through and accept the 
criteria in order to **own" them. 

Concurrent review activities are labor-intensive. They may be 
useful in limiting the use of high-cost services (hospital admission, 
length of stay, expensive technology) but should not be used 
routinely to monitor high-volume, short-term services (e.g., admis- 
sion certification for ambulatory services). 

Retrospective review activities include profile analysis and 
clinical care evaluation studies. The manner in which data for such 
studies are collected and organized has impact upon the way in 
which care will be viewed. We emphasize an approach of gradual in- 
crementalism; that is, examining data, thinking about them, asking 
questions of the data, and then collecting new data and asking 
somewhat more sophisticated questions. Profiles are summaries of 
selected information that allow one to identify patterns of care. 
They permit comparison of individual, unit, or institutional data 
with other individuals, units, or institutions. Profiles are useful for 
generating hypotheses and pinpointing clinical care evaluation 
studies for exploration. 

In designing clinical care evaluation studies we advocate simplic- 
ity. Generally, one ought to use information that is both easily 
retrieved and able to provide the best answers to the most signifi- 
cant questions. Thus one needs to be clear about one's hypotheses in 
the design of these studies. 

The nontechnical aspects of quality assurance are at least as im- 
portant as the technical. Quality assurance demands commitment: 
first the commitment of administration, and then the involvement 
and commitment of staff. This commitment is made manifest in the 
resources avaiUble to quality assurance and in the manner in which 
the result? of a quality assurance program are used within an 
organization and fed back to clinicians and the institution. 

The management of a mental health facility uses authority in the 
service of institutional goals. In this process, management must be 
tecnnically proficient but must also be aware of group dynamics and 
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intergroup issues. Groups tend to work best when members feel 
that work is being accomplished, that status relationships are clear, 
and that individuals have the opportunity to be heard. We envision 
management as continuously aware of its multiple goals, allocating 
and reallocating resources to accomplish its tasks, interactive with 
its environments, and aware of the needs and values of its subsec* 
tors. In a complex organizational matrix, management may tend to 
become excessively bureaucratized as a way of coping with multiple 
external and internal strains. Clarity about major goals and values 
permits an organization to maintain a proactive stance towards its 
environments and to identify and effectively clarify priorities to 
promote organizational ends. 

The processes of quality assurance can be used to help the organi* 
zation identify areas in which individual members or organizational 
subsystems do not conform with established standards. It focuses 
attention on the educational needs of individuals and of the organi- 
zation as a whole and points to areas in which the organization is not 
meeting current goals. 

Practitioners must, however, remember that a quality assurance 
program is intrinsically related to the nature of practice at a par- 
ticular point in time. To the extent that current images of care are 
based upon limited knowledge, or even misconceptions, a quality 
assurance program may be used to reify improper practice. Review 
practices, criteria, and standards should, therefore, be regularly 
reevaluated and updated. In the 18th century, adequate psychiatric 
practice would have involved bleeding and purging patients, spin- 
ning patients rapidly in revolving chairs, and alternating hot and 
cold baths; in later times, patients were subject to extraction of 
teeth to remove assumed local foci of infections. In the 1950s good 
care generally implied very lengthy hospitalization. As knowledge 
accumulates and practice changes, so too must standards and 
criteria. 

Quality assurance programs are costly. Currently, costs average 
between $6 and $12 per episode of care. Critics of the Professional 
Standards Review Organization (PSRO) program insist that the 
costs involved in identifying episodes of inappropriate care are inor- 
dinate, while defenders insist that millions of dollars have been 
saved by limiting the number of hospital days and that simply hav- 
ing a quality assurance program that does concurrent review tends 
to limit hospital days. 

It is not evident that concurrent review is more cost effective 
than a carefully designed system of retrospective review, but it 

)es seem clear that emphasis on containing costs and assuring pro- 
fessional and institutional accountability will require the continued 
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expansion of quality assurance programs (Fulchiero et al„ 1978; 
Giglio, Scharfstein, and DeKaye 1976; McNerney 1976; McSherry 
1976; Thompson 1978), 

There is ongoing national concern with issues of duplication of ef- 
fort and program. This will undoubtedly lead to quality assurance 
programs in mental health care that are compatible with such pro- 
grams in the general health care area. 

The development of quality assurance programs will inexorably 
be tied to issues of reimbursement, and we must also anticipate in- 
creasing conflict among discipline groups as to who is a peer, who is 
competent to engage in which activity, etc. A major task of mental 
health facilities will be the development (within the framework of 
State licensing laws) of criteria for assessing the performance of 
specific clinical tasks and for determining and evaluating clinical 
competence (evidence of licensure or certification, performance 
evaluation, recertification, continuing education, etc.). Such ac- 
tivities are appropriately seen as assuring quality. Even more im- 
portantly, explicit attention to these issues may help limit in- 
tergroup conflict and may promote clarity about tasks. 

Finally, it is important to remember that a cookbook is not a chef. 
Utilization review provides a framework for examining practice and 
ought not become prescriptive. The value of peer review is that it 
allows for modification in practice; it may even tolerate innovation 
and imagination. Quality assurance is with us and will remain with 
us. Our challenge is to use such programs well, to have them ''fit" 
practice and act to improve care and not to allow them to become 
straight jackets which constrain us and choke the development of 
improved care. 
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References listed in the following section have been selected from 
over 250 references identified in two Department of Health and 
Human Services publications. Quality Assurance for Alcohol, 
Drug Abuse, and Mental Health Services: An Annotated Bibliog- 
raphy (DHEW Publication « 79-796), compiled by 0. B. Towery, 
Gordon R. Seidenberg, and Vittorio Santoro, covers the relevant 
literature through 1977. Quality Assurance for Alcohol, Drug 
Abuse, and Mental Health Services: An Annotated Bibliography 
of Recent Literature iHCFA Publication # 80-S00S5), by Tamar 
Joy Kahn and Sophie S. Berger under the direction of Gordon R. 
Seidenberg, reflects the literature from 1977 through the first 
quarter of 1980. 

American Psychiatric Association. Model law on confidentiality of 
health and social service records. American Journal of Psychiatry, 
131(1): 138-144, January 1979. 

The APA Task Force on Confidentiality of Children's and 
Adolescents' Clinical Records and the APA Committee on Confiden- 
tiality prepared this document, which was then approved by the 
APA's Board of Trustees and Assembly Executive Committee. It is 
intended to serve as a prototype for State legislation. Sections 16-18 
provide for protecting patient confidentiality when data is disclosed 
to insurance companies, State or local information systems, or 
federally funded programs. The same journal issue includes an 
editorial (by J. S. Beigler, pp. 71-73) and a commentary (by S. Nye. 
pp. 145-147) on the model law. 
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American Psychiatric Association. Peer Review Committee, Manual of 
Psychiatric Peer Review. Washington, D.C.: The Association. 1976. 

This three-part manual was produced through a collaborative ef- 
fort of the APA, the American Psychoanalytic Association, and the 
American Academy of Child Psychiatry. Part One discusses gen- 
eral, administrative, and legal aspects of psychiatric peer review 
and provides model screening criteria for inpatient and outpatient 
treatment of specific psychiatric disorders. Part Two discusses 
psychoanalytic peer review and includes model criteria sets for 
psychoanalysis. Part Three deals with child psychiatry; model 
screening criteria are presented for intermediate care, for acute 
care, and for partial hospitalization and outpatient treatment of 
psychiatric disorders in children and adolescents. 

American Psychological Association/CHAMPUS National Advisory 
Panel and Staff Members, R. J. Bent, et al. A System of Peer Bedew for 
Outpatient Psychological Services. Washington, D.C.: American 
Psychological Association, October 1979. 

Eight members of the National Advisory Panel and staff of the 
American Psychological Association/CHAMPUS peer review proj- 
ect prepared this document to serve as a model of an ambulatory 
review system which can be utilized in the context of a third-party 
benefits program. It is meant to be of assistance to psychologists 
who provide care to insurance beneficiaries or who wish to set up 
their own review system in an organized care or group practice set- 
ting. It includes a set of criteria for outpatient psychological ser- 
vices similar to those developed for use in the APA/CHAMPUS 
Review System. 

Apostoles, F. E.; Little, M. E.; and Murphy, H. D. Developing a psychi- 
atric nursing audit. Journal of Psychiatric Nursing and Mental Health 

Services, 15(5):9-15, May 1977. 

Three nurses describe in detail the development of an initial, 
primarily process-oriented, nursing pudit in one clinical division of a 
large psychiatric hospital. They also present psychiatric nursing 
criteria based on outcome measures for a retrospective audit of 
suicidal behavior. 

Bartlett, D. P.; and Intagliata, J. Integration of quality assurance and 
program evaluation activities in alcoholism treatment programs: Part 
11. Quality Review Bulletin, 6(l):17-22, January 1980. 

Integration of quality assurance and program evaluation ac- 
tivities in alcoholism treatment programs can enhance the effec- 
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tiveness and efficiency of these activities and encourage greater 
staff support. In this article, second of a two-part series, the authors 
suggest organizational changes meant to facilitate implementation 
of an integrated evaluation system and present a model for involv- 
ing staff extensively in all phases of system design. 

Berkman, B.; and Clark, E. Survey offers guidelines for social work. 
Hospitals, 54(6)1105-106410,112, March 16, 1980. 

An ad hoc committee of the Massachusetts Chapter of the Society 
of Hospital Social Workers conducted a survey of social work prac- 
tice in 40 acute care hospitals. The purpose of the New England 
Regional Survey of Social Work Practice was to develop baseline 
data upon which practice standards could be based. The survey in- 
strument elicited normative profile information on patient social in- 
dicators, medical conditions, social work intervention patterns, 
problems dealt with, and outcomes of intervention. This question- 
naire could now be used as a guide for medical record documenta- 
tion or for review of psychosocial care. 

Brook, R. H.; Kamberg, C. J.; and Lohr, K. N. Quality Assessment in 
Mental Health, Rand Note N4206-^HEW. Santa Monica, Calif.: Rand, 
September 1979. 

The authors examine quality assessment in reference to mental 
health care and the psychosocial aspects of medical care. They 
discuss special issues involved in choosing problems for study, iden- 
tifying applicable and feasible methods, and collecting reliable and 
valid data. They note that mental health professionals have a unique 
contribution to make, both by investigating mental health care 
quality and by collaborating with other health professionals in 
studies of care for nursing home patients. 

Chien. C; Solomon, K.; and Platek, T. E. Macro-monitoring: A step 
toward rational psychopharmacotherapy. American Journal of 
Hospital Pharmacy, 35(4):397402, April 1978. 

A checklist was used to monitor the extent of irrational drug use 
in five different clinical settings: a psychiatric inpatient unit of a 
general hospital a day treatment center of a general hospital, two 
aftercare units of a state hospital and a nursing home regularly 
visited by psychogeriatric consultants. A considerable amount of in- 
appropriate drug use was found. For those psychiatric facilities that 
cannot afford a psychopharmacologist consultant, the checklist 
described here can be a useful tool for monitoring prescribing prac- 
tices. 
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Claiborn, W. L.; and Strieker, G. Professional standards review 
organizations, peer review, and CHAMPUS* Profemonal Psychology, 
10(4);631-639, August 1979. 

The PSRO review system has had a major impact on patterns of 
general hospital care and will probably have a similarly large effect 
on ambulatory care in the future. However, it is not clear that 
medically oriented PSRO review will be appropriate for psychologi- 
cal services. The Civilian Health and Medical Program of the Uni- 
formed Services has contracted with both the American Psychologic 
cal Association and the American Psychiatric Association to 
develop review systems for their respective professions. The ap- 
proaches of the two organizations differ in several important 
respects. The American Psychological Association's CHAMPUS 
peer review experiment could well provide the model for an am- 
bulatory review system in mental health. 



Coulton, C. J. Social Work Quality Assurance Programs: A Com- 
parative Analysis* Washington, D.C.; National Association of Social 
Workers, 1979. 

This monograph reports the findings of a 2'year study of hospital 
social work quality assurance programs that was sponsored by the 
NASW Health Quality Standards Committee. The 27 quality 
assurance programs identified are analyzed and compared. The 
most comprehensive programs consisted of 3 interrelated com- 
ponents: patient information systems, peer reviev^r systems, and 
guaranteed access systems. Recommendations are made in the 
areas of minimum program components, relationship to PSRO, and 
professional issues to be addressed. 

Donabedian, A. Quality of medical are: A concept in search of a defini- 
tion. Journal of Family Medicine, 9(2):227-284, August 1979. 

Patient care consists of technical and interpersonal components: 
''quality" of technical management depends on the balance of its ex- 
pected benefits and risks; ''quality'' of the interpersonal process con- 
sists in coni "mity to legitimate patient expectations and to social 
and professional norms. The author hypothesizes a unifying model, 
which embraces both personal risksA)enefits and social costs/ 
benefits. Admittedly, such a multifaceted definition of quality 
makes it difficult to formulate generalizable criteria and standards. 
Professional schools will have to discover and teach strategies of 
care that yield the highest net utility for the entire population. 
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Goran, M. J- The evolution of the PSRO hospital review system. 
Medical Care, 17(5 SuppL): 147, May 1979. 

The author examines the history of the PSRO program and its 
current status. The program's priority goal at present is to reduce 
the excessive use of hospital care and services throughout the coun* 
try. The author believes that elimination of much of the variation in 
hospital practice patterns would benefit the quality of patient caro 
as well as help to contain costs. He describes the current state of the 
art of hospital revievN including such advances as problem-oriented 
review, the incorporation of cost-effectiveness analysis into the 
review system, and more sophisticated profile analysis. 

Grant, R. L. Problem-oriented system and record keeping in the 
behavioral therapies. Journal of Community Psychology, 7(l):53-59, 
January 1979. 

A major outcome of the disappointment in the adequacy of health 
care records has been the development and increasing adoption of 
Weed's Problem-Oriented Record System. This art??le summarizes 
Weed's approach and proposes that its guidelines and advantages 
are suited for incorporation into behavioral therapy training. The 
expected result of such training should be records more amenable to 
audit or review for such purposes as third-party payment, super 
vision, and peer review. 

Greenstein, M. Quality assurance and program evalnation: Inter- 
actions between diverse approaches to quality of care. Journal of 
Quality Assurance, 2(2):8-ll, Spring 1980. 

The Manhattan Psychiatric Center's review system incorporates 
both patient-centered quality assurance activities and broad-based 
program evaluation studies that cut across clinical units and admin- 
istrative departments. The interaction between the two review 
components has improved communication, increased review staff 
visibility and involvement in hospital affairs, and enlarged the num- 
bers and types of rnonitoriiig approaches available. An operational 
diagram showing the relationship between quality assurance and 
program evaluation components is provided. 

Hastings, G. E.; Sonnerborn, R.; Lee, G. H.; Vick, L.; and Sasmor, L. 
Peer review checklist: Reproducibility and validity of a method for 
evaluating the quality of ambulatory care. American Journal of Public 
Health, 70(3):222-227, March 1980. 

The authors describe the construction and evaluation of a 35 item 
checklist used in performing peer review of ambulatory medical 
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records for a jail health program. Scores obtained by using the 
checklist were carefully evaluated for reproducibility. Both intra- 
reviewer judgments were found to be highly consistent. Peer 
Review Checklist scores also correlated positively with scores ob- 
tained by using a series of specific protocols with explicit criteria. 



Health Standards and Quality Bureau and National Institute of Mental 
Health. Planning for Discharge and Follow-up Services forMentallg HI 
Patients. A. B. Brands, ed. DHEW Publication No. (ADM) 78-673, 
Rockvillei Md.: Superintendent of Documents, U.S. Government Print- 
ing Office. Washington, D.C, 1979. 

The Medicare and Medicaid special conditions of participation for 
psychiatric hospitals require that all patient reCi^rds include a dis- 
charge summary. This publication, which was composed by a work- 
group of NIMH staff and consultants who participate in surveying 
psychiatric hospitals for Medicare certification, describes the 
philosophy and processes involved in developing, carrying out, and 
documenting individualized discharge planning and follow-up ser- 
vices. It is intended to assist surveyors and hospital staffs in demon- 
strating improvements in these areas of treatment. 



InterQual. Intensification Criteria for Concurrent Utilization Review. 
Chicago: InterQual, August 1978, 44 pp. 

This manual describes a special approach to concurrent utilization 
review based on the use of ''intensification" criteria that address 
the appropriateness of short-term hospitalization in terms of the 
severity of illness and the intensity of services prcivided. It includes 
a brief set of psychiatric criteria. 



Joint Commission on Accreditation of Hospitals. Consolidated Stan- 
dards for Child, Adolescents and Adult Psychiatric, Alcoh. % and 
Drug Abuse Programs. Chicago: The Commission, 1979. 

As part of a current effort to streamline its survey and accredita- 
tion process, the JCAH has integrated its standards for all types of 
psychiatric, alcoholism, and drug abuse programs (with the excep- 
tion of community mental health services) into this single compila- 
tion. The standards are listed under four categories: program man- 
agement, patient management, patient services, and facilities 
management. 
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Joint Commission on Accreditation of Hospitals. Principles for Ac- 
ereditation of Community Mental Health Service Programs. Chicago: 
The Commissioni 1979 revision* 

This revision of the 1976 accreditation manual reflects the new 
JCAH ''Balanced Service System'' conceptual model. It is divided in- 
to two sections: a description of the model on which the accredita- 
tion principles (formerly called standards) are based; and a quality 
assurance section which displays each of the principles^ subprin- 
ciples, and performance indicators used. A companion ''Program 
Review Document for Community Mental Health Service Progranis" 
provides the questionnaires and forms used by JCAH surveyors. 

Kass, P.; Charles^ E.; and Buckley, P. Two-year follow-up of a peer 
review training program for residents. American Journal of Psychi" 
atry, 137(2):244-245, February 1980. 

This article briefly describes a participatory peer review training 
program for psychiatric residents in an outpatient setting. A special 
problem-oriented peer review form was devised for the program, 
which involved third-year resident review of the cases of their 
second-year colleagues. Follow-up contact showed that, while both 
training program participants and nonparticipants believe that peer 
review has a positive effect on patient care and on the educational 
process, a striking 80 percent of the participants— a^i opposed to 
none of the nonparticipants — are currently participating in some 
form of peer review. 

Levine, M. S.; Weiner, 0. D.; and Carone, P. F. Monitoring inpatient 
length of stay in a community mental health center. Journal of Ner- 
vous and Mental Disease, 166(9):655-660, September 1978. 

The authors assess their experience with reviewing the length of 
stay in the Connecticut Mental Health Center's inpatient units in 
1974-75. The study helped to refine the review process and led to 
recommendations on selection of cases for review based on their 
educational value. Analysis of cases which exceeded length-of-stay 
norms suggested that these norms should reflect specific treatment 
protocols related to diagnosis rather than diagnosis alone. 

Liptzin, B. A Federal view of mental health program evaluation. Pro- 
fessional Psychology, 8(4):543-552, November 1977. 

Current thinking at the National Institute of Mental Health on 
what evaluation is, whom it is directed to, how it can be used, and 
what other activities relate to it, is discussed. Other topics ad- 
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dressed include the program evaluation and quality assurance im- 
plications of the Community Mental Health Centers Amendments of 
19'/ 5 and the relationship of quality assurance activities to private 
office practice. 

Longabaugh, R.; Fowler, D. R.; Hostetler, M.; McMahon, M.; and 
Sullivan, C. Focus on patient problems: Use of the problem-oriented 
record in a proposed evaluation study of social isolation. Quality 
Review Bulletin, 4(4):4-7, April 1978. 

The authors believe that problem-oriented evaluation studies 
have advantages over diagnostically oriented audits of psychiatric 
topics. They can be adapted to evaluation of interdisciplinary pa- 
tient care and can focus attention on critical behavioral problems. 
Problem-oriented records enable all staff members to record their 
observations on a single form. This article discusses a study to 
assess the care of socially isolated or withdrawn patients in an acute 
care psychiatric facility. The screening elements are listed and ex- 
plained. 

Luft, L. L.; and Newman, D. E. Therapists' acceptance of peer review in 
a community mental health center. Hospital & Community Psychiatry, 
28(12):889-894, December 1977. 

The 80-therapist attending staff of a CMHC was interviewed to 
determine attitudes toward the center^s interdisciplinary peer 
review system. Although many reservations were expressed, the 
system was generally considered to maintain an appropriate 
balance between quality of care and cost control considerations. 
More than 90 percent of the therapists said they found peer review 
to be an educational experience. The authors believe this surpris- 
ingly positive response can be attributed to design of the system by 
and for practitioners and to careful selection and adequate 
remuneration of reviewers. 

Luft, L. L.; Smith, K; and Kace, M. Therapists', patients', and inpatient 
staffs views of treatment modes and outcomes. Hospital & Community 
Psychiatry, 29(8):505-511, August 1978. 

This article explores the correlation between the perceptions of 
patients, therapists, and staff concerning inpatient treatment in a 
community mental health center. Data on 199 consecutive admis- 
sions showed little agreement on the identification of patients* 
symptoms or on assessments of change. There was also little agree- 
ment between therapists and staff in reporting the major treatment 
modalities used or in identifying cases of poor therapists/staff com- 




Annotated Bibliography 



191 



munication. However, neither the use of different treatment ap- 
proaches nor the existence of communication problems was related 
to longer lengths of stay or poorer outcomes. 

Maguire, L. Peer review in community mental health. Community Men- 
tal Health Journal, 14(3):190498, Fall 1978* 

The author discusses the medical origins of review legislation and 
how peer review can be adapted to the unique needs of community 
mental health centers. He suggests three appropriate models in 
review: a problem model, a sequential model using checkpoints in 
patient flow, and Yale's Psychiatric Utilization Review and Evalua* 
tion Project (PURE) model. All three depend upon review of records 
by a committee of respected clinical staff representing a range of 
professions* 

Mansfield, M* The occupation of therapists: Roles of psychiatric oc- 
cupational therapists and preparation of generic audit criteria* Qual- 
ity Review Bulletin, 4(4):8-12, April 1978. 

In preparation for a multidisciplinary psychiatry department 
audit in their hospital, occupational therapists developed generic 
screening elements to assess care provided by members of their 
own profession. This article describes the treatment and documen- 
tation responsibilities of the psychiatric occupational therapists and 
the criteria they developed. 

McAninch, M., and Weedman, R. D. The purpose and content of 
psychiatric records in accreditation procedures. National Association 
of Private Psychiatric Hospitals Journal, 10(3):35-39, Spring 1979. 

The psychiatric patient record serves as a basic source of informa- 
tion for a variety of quality assurance functions. The director and 
deputy director of the JCAH Accreditation Program for Psychiatric 
Fac ilities present guidelines on the type of information that must be 
documented. This includes identification data and the presenting 
problem, assessment information, treatment plans» and follow-up 
and aftercare recommendations. 

McAuliffe, W. E. Measuring the quality of medical care: Process versus 
outcome. Milbank Memorial Fund Quarterly, 57(1):1 18-152, Winter 
1979. 

The desirability of process versus outcome measures of quality is 
an unsettled issue among experts on quality assurance. The primary 
argument for the outcome approach is that, since the goal of the 
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medical care is health, one should concentrate on measuring the 
achievement of health. However, analysis shows that there are 
parallel sets of problems— involving adequacy, validity, and prac- 
tical problems of data collection and quality— in the use of both out- 
come and process measures. The author believes that there is insuf- 
ficient evidence as yet for making a clear choice between the two ap- 
proaches. 

Mitchell, N. L. A suggested schema for utilization review for a com- 
munity mental health center. Journal of the National Medical Associa- 
tion, 69(4):237-239, April 1977. 

The author describes the efforts of an interdisciplinary commit- 
tee to establish a utilization review process for an outpatient menial 
health center. Three record-keeping models were examined: the 
model criteria problem-oriented set, the problem-oriented record, 
and a combination diagnosis and standardized problem list. After 
selecting a combination record format, the committee developed a 
5-phase utilization review procedure. 

National Institute of Mental Health. Psychotropic Drugs: Approaches 
to Psychopharmacohgis Drug Use, Towery, 0. B. and Brandst A.B., eds. 
DHEW Publication No. (ADM) 79-758. Rockville, Md.: Superintendent 
of Documents^ U.S. Government Printing Office, 1979. 

This two-part document was composed to assist community men- 
tal health centers in instituting drug use review programs as part of 
a comprehensive quality assurance system. Part I is a guide for drug 
use review in mental health facilities, written by M. H. Stolar of the 
American Society of Hospital Pharmacists with the guidance of a 
multidisciplinary group of pharmacists, pharmacologists, 
psychiatrists, social workers, and registered nurses. Part II is a set 
of psychopharmacologic screening criteria that was developed by a 
task force of the Peer Review Committee of the American 
Psychiatric Association. 

National Institute of Mental Health. National Standards for Commu- 
nity Mental Health Centers: A Report to Congress. Rockville, Md. 
NIMH, January 1977. 

This report was submitted to Congress by the Secretary of 
Health, Education, and Welfare as required by the Community Men- 
tal Health Centers Amendments of 1976. It begins with a brief 
history of medical standards setting i/i this country, with special at- 
tention to the concerns of mental health care. The second section 
proposes a set of care standards and associated criteria for assess- 
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ing the quality of clinical services in CMHCs. The final section iden- 
tifies a number of potential uses that could be made of the proposed 
standards. 

Nelson, R. H. Program evaluation/quality assurance: A waste of time? 
Journal of Community Psychology, 7(4):368-370, 1979. 

The author asserts that mental health program evaluation has 
failed to become a practical tool and that, given the lack of sufficient 
data to support the development of diagnosis-specific criteria sets 
relating to specific psychological treatment approaches, quality 
assurance is likely to meet the same fate. Individualized treatment 
planning offers a more promising route to meaningful accountability. 

Pilat, J. M. Consideration in evaluation of hospital social work services 
for alcoholic patients. Quality Review Bulletin, 5(ll):20-23, November 
1979. 

The author discusses the many functions a social worker can 
undertake in the treatment of alcoholic patients in hospital settings, 
including roles in the psychosocial evaluation, acute-phase treat- 
ment and discharge planning, and aftercare stages. She suggests 
some general considerations relevant to evaluating the quality of 
such social work services. 

Prien, R. F.; Baiter, M. B.; and Caffey, E. M. Hospital surveys of 
prescribing practices with psychotherapeutic drugs. Archives of 
General Psychiatry, 35(10):1271-1275, October 1978. 

Surveys of hospital psychotherapeutic drug use tend to be critical 
of prescribing practices while failing to provide adequate informa- 
tion for evaluating the appropriateness of these practices. Three re- 
cent multi-hospital surveys of psychotherapeutic drug use are ex- 
amined in detail to illustrate their limitations. It is concluded that 
more intensive studies should be undertaken which focus on long- 
term treatment strategies and reasons for treatment for carefully 
selected, well-defined populations. Such surveys would aid in estab- 
lishing more relevant drug use guidelines and drug utilization 
review systems. 

Samat, J. E.; Whitaker, L. C; and Amstein, R. L. Psychotherapy quality 
assessment. Journal of American College Health. 28(3):13M39, 
December 1979. 

This 3-part paper discusses the need for, conduct of, and problems 
involved in assessing the quality of brief psychotherapy in college 
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mental health services. In part one, Whitaker examines the prac- 
tical and heuristic reasons for developing a systematic quality 
assessment method, Sarnat then describes one in a series of quality 
assessment efforts at the Mental Health Division of the University 
of Massachusetts Health Services^ focusing on the development and 
use of a new method of record-keeping and patient records review. 
In part three, Arnstein discusses difficulties the Yale mental 
hygiene clinic has encountered with quality assessment and adds a 
note of caution about the feasibility and wisdom of embarking on a 
program of quality assessment of psychotherapy, 



Scrivens, J. J., Jr.; Weber* Jr.; Sather, M,; and Geek, W. Filling and 
refilling practices riih diazepam and methyldopa« Hospital For- 
mulary, 14(9):830-838« September 1979. 

A review of the literature reveals that medication misuse, 
predominantly overprescribing, is a widespread problem in health 
care institutions. A study was performed at the Tampa Veterans 
Administration Medical Center to explore the factors contributing 
to excessive use of the drugs diazepam and methyldopa and to 
assess the impact of pharmacist and Pharmacy and Therapeutics 
Committee intervention on misuse of these medications. Prescrip- 
tion use data for the two drugs were reviewed retrospectively for a 
6-month period. Diazepam usage was then monitored prospectively 
for 3 months. The retrospective study demonstrated that many pa- 
tients had received drugs by early refills and/or duplicated prescrip- 
tions. The prospective monitoring program led to substantial reduc- 
tions in the amount of diazepam purchased. 



Seidenberg, G. R.; and Johnson, F. S. A case study in defining 
developmental costs for quality assurance in mental health center pro- 
grams. Evaluation and Program Planning, 2(2):143-153, 1979. 

Despite external demands, community mental health centers 
have been slow to implement quality assurance programs, to a large 
extent because of concerns about the price tag and cost-effective- 
ness of such programs. Drawing upon the experiences of an NIMH- 
supported special project in North Carolina, this paper reports 
specific information from three mental health center programs on 
the start-up costs and staffing of quality assurance activities. The 
report is predicated on the assumption that a quality assurance pro- 
gram should be implemented in building block fashion so as not to 
become a burden on the CMHC's direct service delivery system. 



Annotated Bibliography 



195 



Sharfstein, S. S.; Towery, 0, B-; and Milowe, L D. Accuracy of 
diagnostic information submitted to an insurance company. American 
Journal of Psychiatry, 137(l):70-73, January 1980. 

The Washington Psychiatric Society asked its members for 
anonymous diagnoses for patients they had seen in 1977 under the 
Blue Cross/Blue Shield Federal Employees Program. These 
diagnoses differed markedly from those found by a federally funded 
Mental and Nervous Disorder Utilization and Cost Survey to have 
been submitted in claims for the same patient population. The 
authors reason that inaccurate information was submitted primarily 
because of concern about patient confidentiality. They urge that 
special claims and peer review procedures be developed to assure 
confidentiality and describe such an attempt by the Washington 
Psychiatric Society and Blue Cross/Blue Shield. 



Sheehy, M.; and Charles, E. Evaluation of problem oriented treatment 
planning in outpatient psychotherapy. Journal of Clinical Psychiatry, 
39(7):614-619» July 1978. 

This article presents a systematic evaluation of a modified prob- 
lem-oriented medical record approach applied to psychHherapy 
care in an outpatient psychiatric clinic. As compared with the 4*year 
period preceding institution of problem-oriented treatment plan- 
ning, there was a 50-percent reduction in patient drop-out with no 
change in clinician-rated outcomes. Contrary to the authors' expec- 
tations, staff acceptance of the approach was good. The treatment 
plan format is included. 



SiegeU C; Laska, E.; Griffis, A.; and Wanderling, J. Quantitative care 
norms for a psychiatric ambulatory population in a county medical 
assistance program. American Journal of Public Health, 68(4):352-358, 
April 1978. 

The authors present a method for developing and applying quan- 
titative care norms to acute psychiatric outpatients. Norms were 
generated which relate both to monthly quantity of services 
rendered and to length of active treatment period. Data are 
presented on the application of these norms in Medicaid review, and 
significant findings of variation are explored. The methodology used 
is generalizable to applications ranging from planning to utilization 
review. 
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Silveri L. B. Child psychiatry perspectives: Accountability and the 
future of child psychiatry. Journal of the American Academy of Child 
Fsychiatry, 18(1):176-185, Winter 1979. 

The author reviews the increasing governmental demand for ac- 
countability in medicine and its effect on the practice of child 
psychiatry. He discusses the impact of peer and utilization review 
and the concept of competency and licensurei child psychiatric 
education, and the effect of accountability demands on the "mental 
health of child psychiatrists." He believes that formal accountability 
has a positive influence on the field and that child psychiatrists 
should be actively involved in setting standards. 

Stelmachers, Z. T.; Baxter, J. W.; and Ellenson, G. M. Auditing the 
quality of care of a crisis center. Suicide and Life-Threatening 
Behavior, 8(1):18-31, Spring 1978. 

This article defines different types of audits, lists checkpoints in 
patient flow in a mental facility which lend themselves to review, 
and describes an audit at a hospital-based crisis intervention center. 
The audit was designed to determine the quality of medical- 
psychiatric consultation and to develop criteria for its initiation. 
Corrective actions that resulted included a change in the form for 
recording clinical information, selection of certain activities for con- 
tinuous monitoring, and development of guidelines for dealing with 
requests for frequently abused medications and criteria (list in- 
cluded) for requesting medical-psychiatric consultation. 

Sullivan, F. W. Peer review and professional ethics. American Journal 
of Psychiatry, 134(2):186-188, February 1977. 

The public has not been kept adequately informed on the nature 
and extent of peer review. The author suggests ethical guidelines 
for physicians and committees participating in peer review and 
recommends that review of professional ethics be incorporated into 
the review of the quality, cost, quantity, and availability of medical 
services. 

Towery, 0. B.; and Windle, C. Quality assurance for community mental 
health centers: Impact of P.L. 94-63. Hospital & Community 
Psychiatry, 29(5): 316-319, May 1978. 

The Community Mental Health Centers Amendments of 1975 
mandated three types of quality assurance activities: the develop- 
ment of national standards for CMHCs, the establishment within 
each CMHC of a utilization/peer review program, and creation of a 
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system of program evaluation. The authors describe the CMHC 
standards subsequently developed L;^ the National Institute of Men- 
tal Health, including their relationship to the accreditation stan- 
dards of the JCAH and their potential uses. They also discuss the 
need to establish CMHC quality assurance programs that will inter- 
face with the PSRO program and the kinds of program evaluation 
activities centers are expected to conduct. 

Vanagunas, A. Quality assessment: Alternate approaches. Quality 
Review Bulletin, 5(2):740, February 1979. 

This article summarizes 11 different approaches to quality assess- 
ment: the use of ''tracer" health problems to evaluate overall care; 
health accounting based on evaluation of the level of outcome to be 
expected with optimal quality care; the outcome-based '^staging" ap- 
proach applicable to ambulatory care; the '^bi-cycle" model that com- 
bines auditing and continuing medical education; the Quality 
Assurance Monitor system developed by the Commission of Profes- 
sional and Hospital Activities; the comprehensive quality assurance 
system developed for Kaiser Permanente medical centers; the 
California Medical Association/California Hospital Association 
Educational Patient Care Audit system; the Performance Evalua* 
tion Procedure developed by the Joint Commission on Accreditation 
of Hospitals; concurrent quality assurance; the California Medical 
Insurance Feasibility Study plan; and the criteria mapping ap- 
proach to tracking the physician decision-making process. 

Van Korff, M. R.; and Kramer, M. Mental and Nervous Disorders 
Utilization and Cost Survey. National Institute of Mental Health and 
U,S. Office of Personnel Management, May 1979. 

The Civil Service Commission and the National Institute of Men- 
tal Health funded a survey of the utilization of outpatient mental 
health services during 1977 by enrollees in the Blue Cross and Blue 
Shield Federal Employees Program in the Washington, D.C. area. 
This report describes and analyzes the data that were collected. A 
preliminary attempt is made to use these data to assess the poten- 
tial cost effectiveness of peer review as a utilization control 
mechanism. 

Weiner, 0. D.; Carone, P. F.; Zil, J. S.; Urbin, M. A.; and Ginath, Y. 
Justifying inpatient admissions at a community mental health center. 
Journal of Nervous and Mental Disease, 166(3):153-1(4, March 1978. 

The authors present a model for screening and reviewing CMHC 
inpatient admissions. The model involves use of both a diagnostic 
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criteria set and a functional criteria scale. In a 1976 field test at the 
Connecticut Mental Health Center, it was found that the diagnostic 
criteria set could be applied in three^fourths of the cases and the 
scale of function in all cases. The test also demonstrated that 90 per- 
cent of the admissions could be screened adequat3ly by nonphysi- 
cians. The mean time to process a case was about 58.4 minutes per 
admission, with an average direct cost per case of $6.68. 

West Australian Peer Review Sub-Committee. Peer review— The West 
Australian experience. Australian and New Zealand Journal of 
Psychiatry, 13:353-356, December 1979. 

A pilot study of psychiatric peer review was conducted by a local 
branch of the Royal Australian and New Zealand College of 
Psychiatrists. Participants were divided into three sub-groups, 
which devised their own systems of assessment and data collection. 
Subsequent discussion led to development of a workable system 
that employs a "rolling," or ongoing, technique in which a group of 
four psychiatrists form the peer review group. Following each 
assessment a new member joins the team, and the longest serving 
person is assessed before leaving. The difficulties of peer review are 
discussed, and the importance of the link between peer review and 
continuing psychiatric education is stressed. 

West, J. W. A medical audit of acute alcoholism and chronic 
alcoholism. Alcoholism: Clinical and Experimental Research, 
2(3):287-291, July 1978. 

The author lists the essential characteristics of an acceptable 
medical audit and describes two alcoholism audits in detail. The 
audit for acute alcoholism was conducted in a large private general 
hospital where patients are treated on the general medical service; 
the one for chronic alcoholism involved an alcoholism rehabilitation 
unit in a large general hospital in a teaching center. The audit 
criteria and summaries are included. 

Winlalski, N. Multidisciplinary alcoholism audit covers acute, O.P. 
care. Hospital Peer Review. 3(10):135.137. October 1978. 

A multidisciplinary audit of a community hospital's alcoholism 
unit is described. Both inpatient and outpatient services were ex- 
amined. Criteria were developed and analyses performed by 
members of all professions involved. Audit objectives were to in- 
vestigate the reasons for admission and treatment, to establish 
standards of care, and to evaluate the continuity of care. The audit 
criteria are listed. 
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Wltherety, D. J.; and Spradlin, W. W. A system to document medical 
records for utilization review. Hospital & Community Psychiatry, 
28(12):881,885. December 1977. 

The authors describe the patient progress review sheets used by 
West Virginia University's Department of Behavioral Medicine and 
Psychiatry Inpatient Service for documentation purposes. The 
system was designed for the utilization review process but has also 
been a valuable aid to medical audits. 

Woy, J. R. Quality assurance. In: Boaiuation in Practice: A Sourcebook 
of Evaluation Studies from Mental Health Care Systems in the United 
States, LandJberg, G.; Neigher, W. D.; Hammer, R. J.; Windle, C; and 
Woy, J. R., DHEW Publication No. (ADM) 78-763. Rockville, Md.: 1979. 

The quality assurance section of this NIMH sourcebook on pro- 
gram evaluation consists of an overview by Woy and six summaries 
of individual concurrent review or patient care evaluation projects: 
"The experiences of the quality assurance program in the Connect- 
icut Mental Health Center" by J. Henisz; "Application of utilization 
review procedures in the community mental health center" by W. E. 
Block; "Quality assurance and the Columbia Medical Plan" by J. 
Hankin; "Peer review of prescribing patterns in a CMHC" by H. Dia- 
mond, R. Tislow, T. Snyder, and K. Rickers: "The significance of a 
significant other: how one audit committee chooses to evaluate the 
effectiveness of discharge planning" by R. Longabaugh: and "Clinical 
conferences for synergizing quality assurance activities" by A. 
Richman. Some pertinent references are included in the 
bibliography at the end of the book. 
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